Loading…
Build Stuff 2018 has ended
bigdata [clear filter]
Wednesday, November 14
 

10:50am EET

[SLIDES]Matthew Renze @MatthewRenze - Artificial Intelligence: The Future of Software
Whether you realize it or not, we are currently entering the era of artificial intelligence. AI technologies will radically transform our economy, our society, and our lives. As a result, the software industry is preparing for a major transition as well. However, most developers do not yet possess the skills necessary to remain relevant in our new data-driven economy.
In this session, we will learn about modern artificial intelligence. We'll learn why it’s important and how it will impact you, your career, and our future. We’ll also learn how a series of modern technologies including The Internet of Things, Big Data, and machine learning are combining to create fully autonomous intelligent systems.

Speakers
avatar for Matthew Renze

Matthew Renze

Software Consultant, Renze Consulting
I am a data science consultant, author, and international public speaker. Over the past 18 years, I've taught over 100,000 developers and IT professonals how to make better decisions with data science. My clients include small software startups to Fortune 100 companies around the... Read More →



Wednesday November 14, 2018 10:50am - 11:40am EET
1. Alfa

12:00pm EET

[SLIDES]Santeri Kangas @KangasSanteri - IoT security powered by AI on a cloud scale
Research company Gartner predicts that more than 20B connected devices will be used worldwide by 2020. Protecting and securing IoT devices starts with device identification.

How advanced device identification helps to protect smart homes? How to use the latest cloud technology and innovative machine learning algorithms to secure connected homes? How to scale to 15M households, 100M devices worldwide in one year?

Santeri Kangas shares his insights about running an agile organization that managed to secure the router while deploying the private cloud effectively.

Speakers
avatar for Santeri Kangas

Santeri Kangas

CTO, CUJO AI
Santeri has 26 years of experience in cyber security  and cloud computing, and a commendable track record in building award-winning security software products for network operators. Kangas has worked to successfully organizations, including as a CTO at F-Secure, CTO of vulnerability... Read More →



Wednesday November 14, 2018 12:00pm - 12:50pm EET
2. Beta
  Session

1:50pm EET

[SLIDES]Sam Elamin @samelamin - Lessons learnt implementing scalable, fault-tolerant data pipelines with Apache Spark
ETL pipelines ingest data from a variety of sources and must handle incorrect, incomplete or inconsistent records and produce curated, consistent data that delivers invaluable insight into the customers behaviour
 
In this talk Sam Elamin will relate his real life experience in building robust data processing pipelines powered by Spark that balances the considerations of extreme performance, speed of development, and cost of maintenance.

Sam will walk through building a Datalake using best practice patterns and running hundreds of jobs in parallel using open source tools including Apache Spark, Apache Airflow and Presto that underline systems which are dealing with £100,000 worth of transactions every hour, and more importantly will also highlight the pitfalls to avoid while providing scalable and reliable big data solutions

If you are curious about becoming a data engineer or fancy a move to big data then this is the talk for you!

Speakers
avatar for Sam Elamin

Sam Elamin

Data Engineer, Elamin LTD
My name is Sam and I am a Big Data Engineer as well as a Software Craftsman and Apache Spark evangelist. I am interested in Big Data, Metrics Driven Development, Continuous Delivery and is currently exploring Real Time Analytics, as as well as streaming tools and frameworks like Apache... Read More →



Wednesday November 14, 2018 1:50pm - 2:40pm EET
4. Lambda
  Session
 
Thursday, November 15
 

10:20am EET

Itamar Syn-Hershko @synhershko - SQL on BigData with AWS Kinesis, Presto and Elastic
That thing that happens when your company is scaling so fast you have to replace your infrastructure within weeks or the whole thing crashes. This is what happened to our customer, and this is the story of how we replaced good-ol' SQL with streams and batch processing technologies on AWS.
Using Terraform, Packer, Elasticsearch, AWS Kinesis, Lambda and EMR we were able to provide a truly scalable solution in a matter of weeks, without hurting production and while dealing with a huge scale.
In this talk we will quickly go through the design phase, the various stake holders and how we improved their usage of the system, and introduce the tools that helped us make this happen.

Speakers
avatar for Itamar Syn-Hershko

Itamar Syn-Hershko

Founder & CTO, BigData Boutique
I'm a search technologies, distributed systems and architecture expert. Over the years I built and maintained several big mission-critical systems on both Windows and Linux, and gained a lot of experience I now use to perfect systems built to deal with scale.


Thursday November 15, 2018 10:20am - 11:10am EET
4. Lambda
 


Filter sessions
Apply filters to sessions.