Abstract: This talk explains how to build an end-to-end system that makes non-trivial deductions from natural language text, using only open source software. Infrastructure components include Kafka, Spark Streaming, Spark, and Elasticsearch. Data science components include spaCy, custom annotators, machine learned annotators, and deep learned ontologies. Source code will be made freely available.
Bio: David Talby has been building real-world big data analytics systems in healthcare, finance and e-commerce for over a decade. David has extensive experience in building and operating web-scale data science and business platforms, as well as building world-class, Agile, distributed teams. Prior to joining the startup world, he was with Microsoft’s Bing group, where he led business operations for Bing Shopping in the US and Europe. Earlier, he worked at Amazon both in Seattle and the UK, where he built and ran distributed teams that helped scale Amazon’s financial systems. David holds a PhD in computer science and master’s degrees in both computer science and business administration.