mlops

Adam and Hamza return for a short discussion of what we've been busy working on during the previous few months, where we're going with ZenML and why it's so amazing to be building an open-source tool.

Adam and Hamza introduce themselves for the first episode of Pipeline Conversations. They discuss the world of MLOps, where ZenML sits within this space, and why it's such a complicated problem to solve.

Adam and Hamza introduce themselves for the first episode of Pipeline Conversations. They discuss the world of MLOps, where ZenML sits within this space, and why it's such a complicated problem to solve.

Watch the video of this episode: https://youtu.be/IRkGuRMnZ6o Resources: https://fossa.com/blog/analyzing-legal-implications-github-copilot/ https://github.com/jupyter-naas/awesome-notebooks https://hbr.org/2009/01/picking-the-right-transition-strategy https://papermill.readthedocs.io/en/latest/ Don't forget to register for regular office hours by The Artists of Data Science: http://bit.ly/adsoh Register for Sunday Sessions here: http://bit.ly/comet-ml-oh Listen to the latest episode: https://player.fireside.fm/v2/eac-KT9/latest?theme=dark The Artists of Data Science Social links: YouTube: https://www.youtube.com/c/TheArtistsofDataScience Instagram: https://www.instagram.com/theartistsofdatascience/ Facebook https://facebook.com/TheArtistsOfDataScience Twitter: https://twitter.com/ArtistsOfData

Watch the video of this episode: https://youtu.be/t4HevyAyMbo Resources: https://www.amazon.com/Superminds-Surprising-Computers-Thinking-Together/dp/0316349135 https://www.forbes.com/sites/bernardmarr/2021/10/27/glenfiddich-sells-18000-super-rare-whisky-as-nfts--heres-what-that-means/ Don't forget to register for regular office hours by The Artists of Data Science: http://bit.ly/adsoh Register for Sunday Sessions here: http://bit.ly/comet-ml-oh Listen to the latest episode: https://player.fireside.fm/v2/eac-KT9/latest?theme=dark The Artists of Data Science Social links: YouTube: https://www.youtube.com/c/TheArtistsofDataScience Instagram: https://www.instagram.com/theartistsofdatascience/ Facebook https://facebook.com/TheArtistsOfDataScience Twitter: https://twitter.com/ArtistsOfData

Resources: 🔗 https://missing.csail.mit.edu/ https://www.amazon.com/Pro-Git-Scott-Chacon-ebook/dp/B01ISNIKES/ https://progit2.s3.amazonaws.com/en/2016-03-22-f3531/progit-en.1084.pdf https://www.udemy.com/course/git-and-github-bootcamp/ https://github.com/romkatv/powerlevel10k https://github.com/ericgitonga/code-snippets https://twitter.com/HBOMaxHelp/status/1405712235108917249 https://fossbytes.com/linus-torvaldss-famous-email-first-linux-announcement/ https://theartistsofdatascience.fireside.fm/greg-coquillo https://hbr.org/2009/01/picking-the-right-transition-strategy http://www.jefflichronicles.com/blog/2020/9/26/i-got-7-job-offers-during-the-worst-job-market-in-history-heres-the-data Check it out and don't forget to register for future office hours: http://bit.ly/adsoh Register for Sunday Sessions here: http://bit.ly/comet-ml-oh Listen to the latest episode of Emily Balcetis: http://theartistsofdatascience.fireside.fm/emily-balcetis The Artists of Data Science Social links: YouTube: https://www.youtube.com/c/TheArtistsofDataScience Instagram: https://www.instagram.com/theartistsofdatascience/ Facebook https://facebook.com/TheArtistsOfDataScience Twitter: https://twitter.com/ArtistsOfData

While DevOps offers IT organizations the tools required to deliver application transformation, it isn't until you start to incorporate an awareness of "Data" into a DevOps world that the real power to achieve digital transformation can be achieved. Host Steve McDowell, senior technology analyst at Moor Insights & Strategy, has a wide-ranging conversation with Delphix CEO and founder Jedidiah Yueh about the power of DevOps and why data is the "last automation frontier". They also talk about the intersection of DevOps, machine learning, and MLOps, as well as fostering a culture of innovation. 00:00 Roll the tape... 01:01 Jedidah Yueh's path from high-school teacher to Silicon Valley founder 03:30 Haven't we already solved all the hard DevOps problems? 04:47 DevOps as part of your cyber-security strategy 07:58 DevOps and Application Transformation 10:08 The Delphix Vision 12:06 Intersection of DevOps and MLOps 14:00 ML Models are Just Another Kind of Data 15:50 What's on the horizon in the world of data-driven DevOps? 17:20 Jed's book "Disrupt or Die" and how to foster a culture of innovation 20:20 Data is the last automation frontier 21:27 Wrapping up 21:44 .. the band plays us out Special Guest: Jedidiah Yueh.

Checkout the episode recap here: https://www.comet.ml/site/comet-office-hours-recap-for-may-23rd-and-may-30th/ Comet provides a self-hosted and cloud-based meta machine learning platform allowing data scientists and teams to track, compare, explain and optimize experiments and models. Backed by thousands of users and multiple Fortune 100 companies, Comet provides insights and data to build better, more accurate AI models while improving productivity, collaboration and visibility across teams. Register for future sessions here: http://bit.ly/comet-ml-oh Checkout Comet ML by visiting: https://www.comet.ml/ Checkout the latest FREE e-book from Comet - Building Effective Machine Learning Teams: https://bit.ly/3bWrJ0O Or on Twitter: https://twitter.com/CometML On YouTube: https://www.youtube.com/channel/UCmN63HKvfXSCS-UwVwmK8Hw Vote in the data community content creators awards! http://bit.ly/data-creators-awards Check it out and don't forget to register for Friday Happy Hour sessions: http://bit.ly/adsoh Watch the episode on YouTube here: https://www.youtube.com/playlist?list=PLx-pFwty92wJoWzoO7WlfaM7iYB8qjm Checkout the interview I had with the Super Data Science Podcast: https://www.superdatascience.com/podcast/landing-your-data-science-dream-job [00:01:08] How to deal with the confusion you face while learning new things [00:04:09] Dealing with failed data science projects [00:06:58] How do you go about making sure you collect the right kind of data in the first place? [00:09:29] Start with three questions [00:11:59] The balance between learning technical stuff and learning how to solve actual problems [00:15:28] How are you overcoming learning struggles? [00:18:07] Learning vs doing [00:21:58] When the data doesn’t support much predictive power [00:28:04] Everyone will become a data scientist, eventually [00:30:38] The importance of domain knowledge [00:35:03] Define failure up front [00:37:56] Is low code the end of data science as we know it? [00:42:19] Reproducibility [00:48:25] Adam with some controversy [01:02:36] How do you do personal inventory on your skills?

Comet provides a self-hosted and cloud-based meta machine learning platform allowing data scientists and teams to track, compare, explain and optimize experiments and models. Backed by thousands of users and multiple Fortune 100 companies, Comet provides insights and data to build better, more accurate AI models while improving productivity, collaboration and visibility across teams. Register for future sessions here: http://bit.ly/comet-ml-oh Checkout Comet ML by visiting: https://www.comet.ml/ Checkout the latest FREE e-book from Comet - Building Effective Machine Learning Teams: https://bit.ly/3bWrJ0O Or on Twitter: https://twitter.com/CometML On YouTube: https://www.youtube.com/channel/UCmN63HKvfXSCS-UwVwmK8Hw Vote in the data community content creators awards! http://bit.ly/data-creators-awards Register for Sunday Sessions here: http://bit.ly/comet-ml-oh Check it out and don't forget to register for Friday Happy Hour sessions: http://bit.ly/adsoh Watch the episode on YouTube here: https://www.youtube.com/playlist?list=PLx-pFwty92wJoWzoO7WlfaM7iYB8qjm Checkout the interview I had with the Super Data Science Podcast: https://www.superdatascience.com/podcast/landing-your-data-science-dream-job [00:00:50] Say hello to Austin, Comet’s new Head of Community! [00:03:03] How do you make learning fun? [00:09:20] Learning as a six-step process [00:16:42] We talk about the enigmatic Denis Rothman [00:18:17] The importance of keyboard shortcuts [00:27:46] How to handle requests to speak at events [00:40:28] We start talking about information theory somehow [00:45:08] How to become a better teacher [00:52:19] Don’t have too many tabs open in your brain!

Comet provides a self-hosted and cloud-based meta machine learning platform allowing data scientists and teams to track, compare, explain and optimize experiments and models. Backed by thousands of users and multiple Fortune 100 companies, Comet provides insights and data to build better, more accurate AI models while improving productivity, collaboration and visibility across teams. Register for future sessions here: http://bit.ly/comet-ml-oh Checkout Comet ML by visiting: https://www.comet.ml/ Checkout the latest FREE e-book from Comet - Building Effective Machine Learning Teams: https://bit.ly/3bWrJ0O Or on Twitter: https://twitter.com/CometML On YouTube: https://www.youtube.com/channel/UCmN63HKvfXSCS-UwVwmK8Hw Vote in the data community content creators awards! http://bit.ly/data-creators-awards Check it out and don't forget to register for future office hours: http://bit.ly/adsoh Register for Sunday Sessions here: http://bit.ly/comet-ml-oh Watch the episode on YouTube here: https://www.youtube.com/playlist?list=PLx-pFwty92wJoWzoO7WlfaM7iYB8qjm Checkout the interview I had with the Super Data Science Podcast: https://www.superdatascience.com/podcast/landing-your-data-science-dream-job

The best Comet Office Hour Session to date! Wow - we're picking up steam on Sundays. Be sure to tune into this one, some great conversation and discussions. Register for future sessions here: http://bit.ly/comet-ml-oh Checkout Comet ML by visiting: https://www.comet.ml/ Checkout the latest FREE e-book from Comet - Building Effective Machine Learning Teams: https://bit.ly/3bWrJ0O Or on Twitter: https://twitter.com/CometML On YouTube: https://www.youtube.com/channel/UCmN63HKvfXSCS-UwVwmK8Hw Vote in the data community content creators awards! http://bit.ly/data-creators-awards Check it out and don't forget to register for future office hours: http://bit.ly/adsoh Register for Sunday Sessions here: http://bit.ly/comet-ml-oh Watch the episode on YouTube here: https://www.youtube.com/playlist?list=PLx-pFwty92wJoWzoO7WlfaM7iYB8qjm Checkout the interview I had with the Super Data Science Podcast: https://www.superdatascience.com/podcast/landing-your-data-science-dream-job [00:01:40] How to gain skill in data science [00:07:39] Where can we find data for a project? [00:09:44] Data science project ideas using open data [00:12:59] Sharing code with potential hiring managers and using good frameworks for projects [00:17:01] Do tiny projects to gain skill [00:19:16] A community member shares her experience learning data science while coming from a non-technical background [00:26:11] How do I do “research and stuff”? [00:31:43] Why you need to ask questions and not just go off and do things [00:35:27] Docker, Kubernetes, and Clouds…oh my! What does this have to do with data science? (I provide several non-satisfactory explanations) [00:45:06] What do I need to study?! [00:52:31] Networking [00:53:52] Resume review [01:05:50] What tools do I need to know for data science?

Comet provides a self-hosted and cloud-based meta machine learning platform allowing data scientists and teams to track, compare, explain and optimize experiments and models. Backed by thousands of users and multiple Fortune 100 companies, Comet provides insights and data to build better, more accurate AI models while improving productivity, collaboration and visibility across teams. Register for future sessions here: http://bit.ly/comet-ml-oh Checkout Comet ML by visiting: https://www.comet.ml/ Checkout the latest FREE e-book from Comet - Building Effective Machine Learning Teams: https://bit.ly/3bWrJ0O Or on Twitter: https://twitter.com/CometML On YouTube: https://www.youtube.com/channel/UCmN63HKvfXSCS-UwVwmK8Hw Vote in the data community content creators awards! http://bit.ly/data-creators-awards Check it out and don't forget to register for future office hours: http://bit.ly/adsoh Register for Sunday Sessions here: http://bit.ly/comet-ml-oh Watch the episode on YouTube here: https://www.youtube.com/playlist?list=PLx-pFwty92wJoWzoO7WlfaM7iYB8qjm Checkout the interview I had with the Super Data Science Podcast: https://www.superdatascience.com/podcast/landing-your-data-science-dream-job

Comet provides a self-hosted and cloud-based meta machine learning platform allowing data scientists and teams to track, compare, explain and optimize experiments and models. Backed by thousands of users and multiple Fortune 100 companies, Comet provides insights and data to build better, more accurate AI models while improving productivity, collaboration and visibility across teams. Register for future sessions here: http://bit.ly/comet-ml-oh Checkout Comet ML by visiting: https://www.comet.ml/ Checkout the latest FREE e-book from Comet - Building Effective Machine Learning Teams: https://bit.ly/3bWrJ0O Or on Twitter: https://twitter.com/CometML On YouTube: https://www.youtube.com/channel/UCmN63HKvfXSCS-UwVwmK8Hw Connect with Ayodele LinkedIn: https://www.linkedin.com/in/ayodeleodubela/ Twitter: https://twitter.com/DataSciBae Check out her course on LinkedIn Learning: https://www.linkedin.com/learning/supervised-learning-essential-training/supervised-machine-learning-and-the-technology-boom

Comet provides a self-hosted and cloud-based meta machine learning platform allowing data scientists and teams to track, compare, explain and optimize experiments and models. Backed by thousands of users and multiple Fortune 100 companies, Comet provides insights and data to build better, more accurate AI models while improving productivity, collaboration and visibility across teams. Register for future sessions here: http://bit.ly/comet-ml-oh Checkout Comet ML by visiting: https://www.comet.ml/ Checkout the latest FREE e-book from Comet - Building Effective Machine Learning Teams: https://bit.ly/3bWrJ0O Or on Twitter: https://twitter.com/CometML On YouTube: https://www.youtube.com/channel/UCmN63HKvfXSCS-UwVwmK8Hw Connect with Ayodele LinkedIn: https://www.linkedin.com/in/ayodeleodubela/ Twitter: https://twitter.com/DataSciBae Check out her course on LinkedIn Learning: https://www.linkedin.com/learning/supervised-learning-essential-training/supervised-machine-learning-and-the-technology-boom [00:00:55] Do you think you need to have creativity be creative as a data scientist? [00:06:58] Some tips on how to answer technical interview questions (coding challenges) for machine learning engineer positions [00:11:29] Resume review and tips for resumes [00:20:44] Resume advice for freshers [00:28:29] Tips on how to present projects on your resume [00:31:27] Connecting with people on LinkedIn [00:35:21] The progression from individual contributor data scientists to a leadership role by way of product management [00:40:18] Ayodele talks about her experience at startups [00:42:31] Data Scientists are not like servers at a restaurant. You don't exist just to take orders and then go find things in the data to match these orders. You should be more of a trusted advisor. [00:45:00] Books to build your business acumen [00:47:36] Adopt a “founders mindset”

Comet provides a self-hosted and cloud-based meta machine learning platform allowing data scientists and teams to track, compare, explain and optimize experiments and models. Backed by thousands of users and multiple Fortune 100 companies, Comet provides insights and data to build better, more accurate AI models while improving productivity, collaboration and visibility across teams. Register for future sessions here: http://bit.ly/comet-ml-oh Checkout Comet ML by visiting: https://www.comet.ml/ Checkout the latest FREE e-book from Comet - Building Effective Machine Learning Teams: https://bit.ly/3bWrJ0O Or on Twitter: https://twitter.com/CometML On YouTube: https://www.youtube.com/channel/UCmN63HKvfXSCS-UwVwmK8Hw Connect with Ayodele LinkedIn: https://www.linkedin.com/in/ayodeleodubela/ Twitter: https://twitter.com/DataSciBae Check out her course on LinkedIn Learning: https://www.linkedin.com/learning/supervised-learning-essential-training/supervised-machine-learning-and-the-technology-boom

Comet provides a self-hosted and cloud-based meta machine learning platform allowing data scientists and teams to track, compare, explain and optimize experiments and models. Backed by thousands of users and multiple Fortune 100 companies, Comet provides insights and data to build better, more accurate AI models while improving productivity, collaboration and visibility across teams. Register for future sessions here: http://bit.ly/comet-ml-oh Checkout Comet ML by visiting: https://www.comet.ml/ Checkout the latest FREE e-book from Comet - Building Effective Machine Learning Teams: https://bit.ly/3bWrJ0O Or on Twitter: https://twitter.com/CometML On YouTube: https://www.youtube.com/channel/UCmN63HKvfXSCS-UwVwmK8Hw Connect with Ayodele LinkedIn: https://www.linkedin.com/in/ayodeleodubela/ Twitter: https://twitter.com/DataSciBae Check out her course on LinkedIn Learning: https://www.linkedin.com/learning/supervised-learning-essential-training/supervised-machine-learning-and-the-technology-boom

Comet provides a self-hosted and cloud-based meta machine learning platform allowing data scientists and teams to track, compare, explain and optimize experiments and models. Backed by thousands of users and multiple Fortune 100 companies, Comet provides insights and data to build better, more accurate AI models while improving productivity, collaboration and visibility across teams. Register for future sessions here: http://bit.ly/comet-ml-oh Checkout Comet ML by visiting: https://www.comet.ml/ Or on Twitter: https://twitter.com/CometML On YouTube: https://www.youtube.com/channel/UCmN63HKvfXSCS-UwVwmK8Hw Connect with Ayodele LinkedIn: https://www.linkedin.com/in/ayodeleodubela/ Twitter: https://twitter.com/DataSciBae Check out her course on LinkedIn Learning: https://www.linkedin.com/learning/supervised-learning-essential-training/supervised-machine-learning-and-the-technology-boom HIGHLIGHTS FROM THE SESSION [00:02:21] What does it mean to be an expert in Data science? What's that spectrum look like to go from novice beginner all the way up to expert? [00:04:07] At what point in your career do you feel like you started to deviate from falling recipes? [00:07:41] What does it really mean to be a mentor or a mentee and anybody can become a mentor? [00:18:28] If you're going to approach somebody to be your mentor, then try to make it a positive sum game somehow. [00:21:30] How are you supposed to work with a mentor? [00:23:37] Tor has a dilemma related to cohort analysis and attribution modeling [00:32:20] Helping each other build up confidence in this crazy job search environment [00:36:06] What are some roles that that can help in getting your foot in the door before becoming a data scientist? [00:38:26] What are some interesting job titles you've seen in your search? [00:46:39] How do I ask the correct question? [00:50:38] When you meet people that are very skilled, they go directly into the complexity of the problems and they basically create so many problems. Nobody wants to listen anymore. [00:55:04] I'm consistently taking new classes and courses that I consistently keep meeting new things I don't know. How do you go about it? Is there no end there? We all go around sharing ideas for how to learn more efficiently. [01:04:52] The quest for a golden resource [01:11:24] Tips for coding round interviews [01:16:54] Do we need OOP in data science? [01:18:47] Should I go to grad school?

Comet provides a self-hosted and cloud-based meta machine learning platform allowing data scientists and teams to track, compare, explain and optimize experiments and models. Backed by thousands of users and multiple Fortune 100 companies, Comet provides insights and data to build better, more accurate AI models while improving productivity, collaboration and visibility across teams. Register for future sessions here: http://bit.ly/comet-ml-oh Checkout Comet ML by visiting: https://www.comet.ml/ Or on Twitter: https://twitter.com/CometML On YouTube: https://www.youtube.com/channel/UCmN63HKvfXSCS-UwVwmK8Hw Connect with Ayodele LinkedIn: https://www.linkedin.com/in/ayodeleodubela/ Twitter: https://twitter.com/DataSciBae Check out her course on LinkedIn Learning: https://www.linkedin.com/learning/supervised-learning-essential-training/supervised-machine-learning-and-the-technology-boom [00:01:17] We talk about the madness of the data science interview process [00:02:29] Why are why are we making it so difficult for people to even get considered for an interview? [00:05:41] Could data science benefit from a series of exams and accreditations, much like actuaries have to do? [00:07:53] How does one prepare for these technical questions? [00:11:35] How long should you spend preparing for an interview? [00:12:58] What are considered medium/hard type of questions? [00:16:02] Am I expected to have an answer for everything? [00:20:46] How many projects should I have, and what should they be like? [00:24:25] How should I be allocating my time in the job search process? [00:25:17] Book recommendations [00:28:30] Notebooks or scripts? [00:30:53] How to explain your projects? [00:35:07] Mark talks about some stuff he’s doing at work around creating and defining metrics and KPIs [00:41:16] Tor jumps in with some sage advice [00:44:46] Measuring the monetary value of your efforts [00:50:10] How do you get managers buying into creating a data project? [00:54:21] Explaining the value of your passion projects in an interview [00:57:03] NLP question time

Comet provides a self-hosted and cloud-based meta machine learning platform allowing data scientists and teams to track, compare, explain and optimize experiments and models. Backed by thousands of users and multiple Fortune 100 companies, Comet provides insights and data to build better, more accurate AI models while improving productivity, collaboration and visibility across teams. Register for future sessions here: http://bit.ly/comet-ml-oh Checkout Comet ML by visiting: https://www.comet.ml/ Or on Twitter: https://twitter.com/CometML Connect with Ayodele LinkedIn: https://www.linkedin.com/in/ayodeleodubela/ Twitter: https://twitter.com/DataSciBae Check out her course on LinkedIn Learning: https://www.linkedin.com/learning/supervised-learning-essential-training/supervised-machine-learning-and-the-technology-boom [00:01:05] When we talk about data validation, what is it that we mean? [00:03:19] A data sheet? What is that? [00:05:30] What’s a good approach to asking questions for a data science project? [00:10:41] Sampling is important [00:17:54] Where does data validation fall in the data science lifecycle? [00:18:31] Where in the pipeline do I perform cross-validation? [00:21:00] How do algorithms know which content to push to you and how can I affect the content being pushed my way? [00:26:26] There is a lack of transparency when it comes to these algorithms [00:30:50] Some more excellent discussion around ethics in machine learning [00:32:52] Ayodele drops some sage insight on how machine learning algorithms are used and the ethics of it all [00:36:20] How to go from data to decisions [00:43:10] What exactly is an insight? [00:47:09] What comes first: the question or the data? [00:53:22] How do you create a narrative around your analysis? [01:02:09] How do you talk about the narrative in your project? [01:05:14] Eliminating data feeds that are wasting money, why are you collecting data that you don’t use? [01:11:23] What’s your favorite data science book?