MotherDuck’s Post

DuckDB is like a Swiss Army knife for data operations. It doesn't get simpler than that to convert files back and forth, does it? #data #duckdb

2023 UK MOT tests summary using duckdb I decided to build my first duckdb project with motherduck and settled on using 2023 UK MOT Test data. This data came from the UK Gov open data portal website. Using duckdb I very quickly summarised 42mil rows of data, I decided to just use "Normal MOT test" data which reduced to the data to 35mil rows, pushing the results to motherduck use for online. I decided to use preset (as i already had an account for my previous POC) its easy to use and had a dashboard up and running in now time. What I didn't do on my POC was try and share my dashboard, so this time I came across a problem. I could not share the report publicly for anybody to view. I would have to add people and they have to sign up to preset, so I've exported the report to show on here. #dataanalysis #etl #datapipeline #dataengineering #duckdb #motherduck

How many versions of "final" data files does your team have? It’s like playing detective to find out which file is actually final. V10_FINAL V10_FINAL_FINAL V10_FINAL_MOST_FINALIZED_FINAL V11 #datahumor or is it #datapain

Getting ready to schedule my next #splunk exam #Powerusers. Feels good to get familiar with these more advanced techniques with data. http://www.yourtech.online #Regex #correlationanalysis #datamodels #pivottables

📢 ❗IMPORTANT NOTICE❗: The ORCID Registry (including Public and Member API and the ORCID Registry user interface) are available as normal — many thanks for your patience while we migrated our systems to a new data center!

DuckDB Out Of Memory – Has it been fixed? https://lnkd.in/gfev77SN #dataengineering #duckdb #data