Is is possible to only download a subset? e.g. Show HNs or HN Whoishiring. The S... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		Onavo 28 days ago \| parent \| context \| favorite \| on: Show HN: Hacker News archive (47M+ items, 11.6GB) ... Is is possible to only download a subset? e.g. Show HNs or HN Whoishiring. The Show HNs and HN Whoishiring are very useful for classroom data science i.e. a very useful set of data for students to learn the basic of data cleaning and engineering.

nelsondev 28 days ago [–]

It’s date partitioned, you could download just a date range. It’s also parquet, so you can download just specific columns with the right client

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact