Taking a Break, But Big Things Are Coming

The Hidden Heroes Behind AI - how datasets, not just transformers, are shaping the future of AI.

#beyondAI

Time for a break.

This past year has been packed. I started a new role at Vodafone, where I’m responsible for the internal AI Product strategy for our signature AI product (which I’ll introduce later).

We’re also creating a new organizational structure to improve internal AI product development and stay connected with our group entity.

And if all goes well – I will be a first-time co-founder of an organization within an enterprise. Wish me luck 🍀

Hope to share more on that soon.

But that’s just my 9-5.

In August last year, I began posting about AI Product Management on LinkedIn, and by April 2024, I started writing long-form content on Substack—every week, non-stop.

Now, it's time for a short break.

To give you a taste of what's next, here's a sneak peek of one of my upcoming long-form posts.

Happy reading 🛋️

---

It's a shame that the transformer architecture gets all the attention for LLMs, while the datasets—like RedPajamaV2 with 100 billion text documents—are often overlooked. The tech behind creating these massive datasets deserves recognition too.

Just imagine how long it would take to manually prepare all that data, even with hundreds of employees.

From data acquisition to preparation, creating datasets for LLMs is a complex process. First, the data must be cleaned to ensure it's accurate and relevant. Then, it’s annotated to add context. We also need to make sure the datasets are diverse and inclusive to avoid bias. It takes a lot of technology to process and manage this data while maintaining privacy and ethical standards.

These datasets are some of the most valuable assets humanity has ever compiled. They're real data products that power AI.

In fact, creating these data products involves so much machine learning, they could be considered AI products too 😎

And tbh, i think it’s more appropriate to call them exactly this.

+++

But more after my vacation.

See you soon.

JBK 🕊️

---