python – Manage Data: Unprocessed data, processed data, and results from processed data

I've created a Python process that automates part of the process of editing support tickets in Salesforce. With selenium I extract all open support tickets and save them in an archive. From this list, I'll do some things (finding duplicate account records and finding additional account information) and save the results in 2 different directories: 1 for support tickets for non-duplicate accounts and another for potential duplicate records. And for each of these directories, I continue to edit them and save the results in another directory pair.

Here's an example of my directory structure:

ticket Processor
| - ticket_archive
| | - all_tickets_06_17_2019.pkl
| | - all_tickets_06_18_2019.pkl
| | - all_tickets_06_19_2019.pkl
| `- all_tickets_06_20_2019.pkl
| - non_duplicates
| | - approved
| | | - processing_06_20_2019.pkl
| | | - processing_06_21_2019.pkl
| | `- processing_06_22_2019.pkl
| | - failures
| | | - failed_06_20_2019.pkl
| | `- failed_06_22_2019.pkl
| `- unprocessed
| | - staged_for_approval_06_19_2019.pkl
| `- staged_for_approval_06_21_2019.pkl
`- potential duplicates
| - potential_duplicates_06_20_2019.pkl
| - potential_duplicates_06_21_2019.pkl
`- Potential_duplicates_06_22_2019.pkl

I'd like to know if there are some software paradigms for managing these ever-growing directories to determine the current state and subset of the data being processed.

My previous approach is to create a class TotalTicketScanner by simply extracting all support numbers (the unique ID for each support ticket) and making a record for each directory of support numbers. I'll make sure there's no new ticket in this pipeline so I do not duplicate my efforts.

I realized that this problem is not clear, and would be glad if someone pointed me to information about such problems

Thank you very much!

Refusal of entry – ESTA refused, visa still being processed

For the visa exemption and the arrival by plane you need an ESTA. Without one you can not board a plane to the USA.

Technically, you could fly to Canada or Mexico and drive across the border to the US. However, if your ESTA has been rejected, it means that the US has a reason why they may not want you in the country. Depending on the circumstances, there is a high probability that you will be rejected at the border.

Develop – How many rolls can be processed with ILFORD powder developers in different dilutions?

Your numbers sound correct.

If you use multiple rolls of film in a given development run, you must Do not Increase your development time beyond what you expect when you run a single role.

If the chemistry takes X minutes, you should develop it for X minutes, whether you have a 1-roll 1-roll reel or a 10-reel massive 10-roll reel. The chemistry used to cover the rolls contains the volume of chemicals needed to develop this roll [for the specified length of time]and the fact that other rollers are in the same tank does not affect the time required.

Their time adjustments only need to be made if the chemistry is reused to take into account what has already been used up a bit from an earlier development.

Diluted one-shot development options require consistency, reliability, and ease-of-use. There are no additional steps to follow, no adjustment times due to previous use, etc. Mix your chemistry, fill the tank, and develop the properties required for the combination of film and exposure.

  • If you're using 1: 1 in one shot, swap a few reels for capacity so the reel is consistent.
  • With 1: 3 you get a few roles, but also increase your development times.

There will also be subtle differences in the appearance of your shadows and lights between the different dilutions.

Personally, I prefer to run only with a 1: 1 ID-11 [or Kodak’s D76 – They only differ in how they’re mixed for shipping.] for the sake of simplicity.


And a funny side note: If you ever switch to medium format, Paterson tanks were developed for the longer 220 movie. If you're brave, you can actually load two 120-roll rolls onto a roll by sticking them together. However, there is a risk that the rollers will overlap and cause poor development. Therefore, this method should be used with the utmost care.

Rules – Variables are not processed in Drupal Core 8.7.0

I used Drupal Core Release 8.6.15 with the Business Rules module (https://www.drupal.org/project/business_rules) and everything worked fine until I upgraded my site to Core Release 8.7.0 and the Site still works, but the Business Rules engine does not work with the last core version.

The module seems to have been without maintenance for at least 3 months, but my website uses this module too often, especially for getting and updating entities based on some user actions.

I have seen this problem here (https://www.drupal.org/project/business_rules/issues/3016888) and it seems that the variables are not processed and return NULL values ​​…

Can anyone point out how this issue might be fixed, or at least what has changed in Core 8.7.0 in terms of variables, so I can try to fix it myself?

Many Thanks

macos – The last number file processed and the folder where the file was located were not found

A time machine backup is good in such cases. If you are using a time machine, open it while opening the folder location in the Finder, and return to the time the folder was there.

If you have deleted it, there should be a copy in the trash. Look there too.

People sometimes accidentally move files or folders or rename them. A terminal search for the filename can also find them in hidden directories and system directories if your setup allows you to drag objects.

I'm afraid it's very unlikely that a tool can recover it without backup, as it's probably already overwritten by what you've done in the meantime. This usually only works if you do not do much with the Mac and start the Undelete tool from another hard drive. But you can try it, especially if it's important.

Try to avoid adding anything to the hard drive – files, apps, updates, and even logs (which the computer automatically does when you use them) until you recover the file.

You may also want to spend money on professional recovery services if the file is really important. Their chances are higher as they know which tools are best suited for their frequent use. But I doubt that they will succeed.

I suggest starting Time Machine from now on – it runs in the background and allows you to recover such files.

How do I download the image shown on the website even though it is processed with JavaScript?

So it's a specific and strange question for a Polish website, but it's generic and you do not need to understand the website itself to understand what I'm talking about.

As the title implies, I must be able to download the image of the product in full size on the website. The problem is, the pictures of the products are shown by JS. To achieve my goal, I can not just click and download with the right mouse button. To see what I'm talking about, just click on the big picture of the product in the middle. You will see that it will expand to a higher resolution, but still can not be easily downloaded.

If your answer requires some programming or touching codeI am more than happy to hear it. If I have to learn something, I will write it anyway. Although I write this with the idea that I have to program my solution, I found this page more suitable than StackOverflow.

What I tried and thought:

  • Somehow, the requests to the website are trapped as they go through the highest resolution images, but that seems to be incredibly complicated. It takes around at least 3 days, that seems to be a waste of time.

  • Turn off JS and then just download the pictures. Unfortunately, I can only download one and not the highest resolution I need.

Thanks in advance for your help!

gui design – Should I display data processed by the software?

I'm writing a software that uses Python / wxPython, and this software uses a dictionary to store the data I'm going to process. And what users see is just a ListCtrl (that has a few lines and columns) displays the default data and the data you entered.

The dictionary is a kind of:

dictOfItems = {
& # 39; # 39 & person1 ;: ["Josh", "34 years", "Single"],
& # 39; # 39 & person2 ;: ["Karl", "17 years", "Single"],
& # 39; # 39 & person3 ;: ["John", "27 years", "Married"]
  ...
}

The point is, the dictionary uses keys to distinguish one object from another, so users can place many individuals (if they have) without worrying about overwriting an existing person.

Should I display the IDs on this ListCtrl? Or should I just keep it to myself and keep it as clean as possible?

Does the fact that the amortized cost of each Extract-Max operation is $ O (1) $ mean that the entire sequence can be processed in $ O (n) $ time?

Imagine an ordinary n-element binary max-heap data structure supporting the insertion and extraction of max in $ O (log (n)) $ Worst-case time.

Q) Consider a sequence of n extract max operations performed on a heap H that was initially performed
contains n elements. Does the fact that the amortized costs are incurred for each extract-maximum-process?
is $ O (1) $ means that the entire sequence can be processed in $ O (n) $ Time? Justify your answer.

Answer: No, a series of n EXTRACT_MAX will cost you $ O (nlogn) $, This is because in a heap, the leaves are almost at the same level and the number of leaves in a heap is $ O (n / 2) = O (n) $, Each time you call EXTRACT_MAX, the maximum element is removed from the root and replaced with a new second maximum element, and one leaf decrements. So all leaves are decremented $ O (n) $) lasts every time logn, since all leaves are almost at the same level, which results in a temporal complexity of $ O (nlogn) ^ {1/4} $,

Does it make sense?

India – Jio Recharge – Payment can not be processed Error

I am in India and trying to recharge my Jio account. I am constantly receiving the error "Payment Error – Your request to load can not be processed at this time, please try again later". I started trying it 24 hours ago, and I get the same error message. Is there a way to work around it? I have two master cards issued by European banks (Unicredit and N26).

8 – Cron processes items through the queue worker as they are processed after the queue completes

I have a cron job that calls a queue worker to process items. In the cron function I would like to perform further actions on the data after processing the elements. How can I tell if the queue is complete? Should I make a separate cron for this task?

Current logic in cron function:

  1. (CRON) There is a content type with a field (updated) in which it can be tracked whether the node is updated or not. For all nodes of this content type, set the updated field to FALSE.
  2. (CRON) For each row, retrieve data from an external table that is stored in QueueWorker for processing.
  3. (QUEUEWORKER) Check in the QueueWorker whether there is already a node for this line. Otherwise, create a new node. If the node exists, update it. For both, set the updated field to TRUE and save the node.
  4. (CRON) After all the rows in the queue have been processed, go back to retrieve all the content type nodes and find those that have the updated field NOT set to TRUE and delete them.

Since steps 3 are a queue process, the elements are processed as a separate "thread". This means that article 4 is completed before the articles are actually processed. My question is, how do I perform step 4 after all the lines in QueueWorker have been processed? Should I create a separate cron job for node deletion?