Calculate Time Difference Between Two Pandas Columns in Hours 以 Fixed Time 模式进行交易 and Minutes
I have two columns, fromdate and todate , in a dataframe.
I add a new column, diff , to find the difference between the two dates using
I get the diff column, but 以 Fixed Time 模式进行交易 it contains days , when there's more than 24 hours.
How do I convert my results to only hours and minutes (i.e. days are converted to hours)?
3 Answers 3
Trending sort is based off of the default sorting method — by highest score — but it boosts votes that have 以 Fixed Time 模式进行交易 happened recently, helping to surface more up-to-date answers.
It falls back to sorting by highest score if no posts are trending.
Switch to Trending sort
Pandas timestamp differences returns a datetime.timedelta object. This can easily be converted into hours by using the *as_type* method, like so
The astype workaround works, but it is too slow for large (0.5 Million rows) files. Any other suggestions?
This was driving me bonkers as the .astype() solution above didn't work for me. But I found another way. Haven't timed it or anything, but might work for others out there:
. if you want hours. Or:
. if you want minutes.
UPDATE: There used to be a helpful comment here that mentioned using .total_seconds() for time periods spanning multiple days. Since it's gone, I've updated the answer.
A former federal prosecutor says Donald Trump may have committed 'treason' by launching 'an armed attack on the Capitol'
Donald Trump asked daughter Ivanka to get him a meeting with Hillary Clinton after the 2016 election, Jared Kushner says in upcoming memoir
Trump wanted to establish a "cordial relationship" with Clinton after the fractious presidential election of 2016, says Kushner writes, per The Hill.
Mark Zuckerberg unveils new, boyish metaverse avatar after getting mocked for creepy, dead-eyed version
The Meta CEO posted his new, high-res avatar on Instagram on Friday after Monday's low-res iteration was widely mocked.
The FBI raid made Trump into a 'martyr' and stronger than ever, icing out potential 2024 rivals like Gov. Ron DeSantis, GOP insiders say
Trump saw a massive fundraising boost after the FBI search and potential 2024 GOP rivals swooped in to defend him.
Get industry news with our daily newsletters
Get a daily selection of our top stories based on your reading preferences.
Our weekday newsletter, packed with original analysis, news, and trends — delivered right to your inbox.
Get the latest tech news & scoops — delivered daily to your inbox.
Get the inside scoop on what traders are talking about — delivered daily to your inbox.
There's a simple fix for America's housing crunch: stop taxing housing
Sedona, Arizona will pay cash to Airbnb hosts who stop short-term renting. The strategy is catching on as popular spots try to take back housing for locals.
The city will offer up to $10,000 to hosts who sign a one-year lease with a local instead. Vermont and California spots are trying the same thing.
Trump said Dr. Oz will 'lose' the Pennsylvania Senate race without a course correction and questioned how the longtime TV personality could be lagging in polls: 以 Fixed Time 模式进行交易 report
Trump said it would be "embarrassing" for Oz to lose to John Fetterman, whom the ex-president reportedly refers to as "that guy," per Rolling Stone.
Finland's 36-year-old prime minister takes drug test after 'wild' party videos emerge
Finland's 36-year-old PM told reporters she took a drug test on Friday to "clear up any doubts" and protect her legally after partying videos emerged.
An Ethiopian Airlines flight missed its descent into a major airport because the pilots fell asleep, report says
Ethiopian Airlines said the crew "have been removed from operation" and "appropriate corrective action will be taken" after an investigation.
I toured the first-class cars on the Rocky Mountaineer train where tickets cost $1,960 and come with a luxe bar that's off-limits to other passengers
On Rocky Mountaineer trains, Silverleaf Plus is similar to first class and comes with two exclusive bar cars, an extra tour guide, and other perks.
Pricing: 以 Fixed Time 模式进行交易 why pay for what you don’t use?
Pay for the compute and storage you actually use.
Turn compute resources on and off, so you only pay for what you use
Take advantage of cost-effective compression in Snowflake to store near unlimited amounts of data
Grow your analytics infrastructure with linear cost scalability
Get started with options that fit your needs
Snowflake offers multiple editions of our Data Cloud service. For usage-based, per-second pricing with no long-term commitment, sign up for Snowflake On Demand™ – a fast and easy way to access Snowflake. Or, secure discounts to Snowflake’s usage-based pricing by buying pre-purchased Snowflake capacity options. Please contact us for additional information.
Compute usage is billed on a per-second basis, with a minimum of 60 seconds.
Speed up writing to files
I've profiled some legacy code I've inherited with cProfile. There were a bunch of changes I've already made that have helped (like using simplejson's C extensions!).
Basically 以 Fixed Time 模式进行交易 this script is exporting data from one system to an ASCII fixed-width file. Each row is a record, and it has many values. Each line is 7158 characters and contains a ton 以 Fixed Time 模式进行交易 of spaces. The total record count is 1.5 million records. Each row is generated one at a time, and takes a while (5-10 rows a second).
As each row is generated it's written to disk as simply as possible. The profiling indicates that about 19-20% of the total time is 以 Fixed Time 模式进行交易 以 Fixed Time 模式进行交易 spent in file.write() . For a test case of 1,500 rows that's 20 seconds. I'd like to reduce that number.
Now it seems the next win will be reducing the amount of time spent writing to disk. I'd like to reduce it, if possible. I can keep a cache of records in memory, but I can't wait until the end and dump it all at once.
My first thought would be to keep a cache of records in a list and write them out in batches. Would that 以 Fixed Time 模式进行交易 be faster? Something like:
My second thought would be to use another thread, but that makes me want to die inside.