Date: Wed, 14 Feb 2018 00:00:00 +0000
<p>This week, we dive into machine learning bias and fairness from a social and technical perspective with machine learning research scientists <a href="https://twitter.com/timnitgebru">Timnit Gebru</a> from Microsoft and <a href="https://twitter.com/mmitchell_ai">Margaret Mitchell</a> (aka Meg, aka M.) from Google.</p> <p>They share with <a href="https://twitter.com/nyghtowl">Melanie</a> and <a href="https://twitter.com/Neurotic">Mark</a> about ongoing efforts and resources to address bias and fairness including diversifying datasets, applying algorithmic techniques and expanding research team expertise and perspectives. There is not a simple solution to the challenge, and they give insights on what work in the broader community is in progress and where it is going.</p> <h5 id="timnit-gebru">Timnit Gebru</h5> <p><a href="https://www.microsoft.com/en-us/research/people/tigebru/">Timnit Gebru</a> works in the Fairness Accountability Transparency and Ethics (FATE) group at the New York Lab. Prior to joining Microsoft Research, she was a PhD student in the Stanford Artificial Intelligence Laboratory, studying computer vision under Fei-Fei Li. Her main research interest is in data mining large-scale, publicly available images to gain sociological insight, and working on computer vision problems that arise as a result, including fine-grained image recognition, scalable annotation of images, and domain adaptation. The Economist and others have recently covered part of this work. She is currently studying how to take dataset bias into account while designing machine learning algorithms, and the ethical considerations underlying any data mining project. As a cofounder of the group Black in AI, she works to both increase diversity in the field and reduce the impact of racial bias in the data.</p> <h5 id="margaret-mitchell">Margaret Mitchell</h5> <p><a href="http://www.m-mitchell.com/">M. Mitchell</a> is a Senior Research Scientist in Google’s Research & Machine Intelligence group, working on artificial intelligence. Her research involves vision-language and grounded language generation, focusing on how to evolve artificial intelligence toward positive goals. Margaret’s work combines machine learning, computer vision, natural language processing, social media, and insights from cognitive science. Before Google, Margaret was a founding member of Microsoft Research’s “Cognition” group, focused on advancing artificial intelligence, and a researcher in Microsoft Research’s Natural Language Processing group.</p> <h5 id="cool-things-of-the-week">Cool things of the week</h5> <ul> <li>GPS/Cellular Asset Tracking using Google Cloud IoT Core, Firestore and MongooseOS <a href="https://medium.com/google-cloud/gps-cellular-asset-tracking-using-google-cloud-iot-core-firestore-and-mongooseos-4dd74921f582"> blog</a></li> <li>GPUs in Kubernetes Engine now available in beta <a href="https://cloudplatform.googleblog.com/2018/02/accelerate-highly-parallelized-compute-tasks-with-GPUs-in-Kubernetes-Engine.html"> blog</a></li> <li>Announcing Spring Cloud GCP - integrating your favorite Java framework with Google Cloud <a href="https://cloudplatform.googleblog.com/2018/02/announcing-Spring-Cloud-GCP-integrating-your-favorite-Java-framework-with-Google-Cloud.html"> blog</a><br /></li> </ul> <h5 id="interview">Interview</h5> <ul> <li>PAIR | People+AI Research Initiative <a href="https://ai.google/pair">site</a></li> <li>FATE | Fairness, Accountability, Transparency and Ethics in AI <a href="https://www.microsoft.com/en-us/research/group/fate/">site</a></li> <li>Fat* Conference <a href="https://fatconference.org/">site</a> & <a href="https://fatconference.org/links.html">resources</a></li> <li>Joy Buolamwini <a href="https://www.media.mit.edu/people/joyab/overview/">site</a></li> <li>Algorithmic Justice Leaguge <a href="https://www.ajlunited.org/">site</a></li> <li>ProPublica Machine Bias <a href="https://www.propublica.org/article/machine-bias-risk-assessments-in-criminal-sentencing"> article</a></li> <li>AI Ethics & Society Conference <a href="http://www.aies-conference.com/">site</a></li> <li>Ethics in NLP Conference <a href="http://www.ethicsinnlp.org/">site</a></li> <li>FACETS <a href="https://pair-code.github.io/facets/">site</a></li> <li>TensorFlow Lattice <a href="https://github.com/tensorflow/lattice">repo</a></li> </ul> <p>Sample papers on bias and fairness:</p> <ul> <li>Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification <a href="http://proceedings.mlr.press/v81/buolamwini18a.html">paper</a></li> <li>Facial Recognition is Accurate, if You’re a White Guy <a href="https://www.nytimes.com/2018/02/09/technology/facial-recognition-race-artificial-intelligence.html"> article</a></li> <li>Mitigating Unwanted Biases with Adversarial Learning <a href="https://arxiv.org/pdf/1801.07593.pdf">paper</a></li> <li>Improving Smiling Detection with Race and Gender Diversity <a href="https://arxiv.org/pdf/1712.00193.pdf">paper</a></li> <li>Fairness Through Awareness <a href="https://arxiv.org/pdf/1104.3913.pdf">paper</a></li> <li>Avoiding Discrimination through Casual Reasoning <a href="https://arxiv.org/pdf/1706.02744.pdf">paper</a></li> <li>Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings <a href="https://arxiv.org/pdf/1607.06520.pdf">paper</a></li> <li>Satisfying Real-world Goals with Dataset Constraints <a href="https://papers.nips.cc/paper/6316-satisfying-real-world-goals-with-dataset-constraints.pdf"> paper</a></li> <li>Axiomatic Attribution for Deep Networks <a href="https://seejane.org/research-informs-empowers/data/">paper</a></li> <li>Monotonic Calibrated Interpolated Look-Up Tables <a href="http://www.jmlr.org/papers/volume17/15-243/15-243.pdf">paper</a></li> <li>Equality of Opportunity in Machine Learning <a href="https://research.googleblog.com/2016/10/equality-of-opportunity-in-machine.html"> blog</a></li> </ul> <p>Additional links:</p> <ul> <li>Bill Nye Saves the World Episode 3: Machines Take Over the World (includes Margaret Mitchell) <a href="https://www.netflix.com/title/80117748">site</a></li> <li>“We’re in a diversity crisis”: Black in AI’s founder on what’s poisoning the algorithms in our lives <a href="https://www.technologyreview.com/s/610192/were-in-a-diversity-crisis-black-in-ais-founder-on-whats-poisoning-the-algorithms-in-our/"> article</a></li> <li>Using Deep Learning and Google Street View to Estimate Demographics with Timnit Gebru <a href="https://twimlai.com/twiml-talk-88-using-deep-learning-google-street-view-estimate-demographics-timnit-gebru/"> TWiML & AI podcast</a></li> <li>Security and Safety in AI: Adversarial Examples, Bias and Trust with Mustapha Cisse <a href="https://twimlai.com/twiml-talk-108-security-safety-ai-adversarial-examples-bias-trust-moustapha-cisse/"> TWiML & AI podcast</a></li> <li>How we can build AI to help humans, not hurt us <a href="https://www.ted.com/talks/margaret_mitchell_how_we_can_build_ai_to_help_humans_not_hurt_us"> TED</a></li> <li>PAIR Symposium <a href="https://sites.google.com/corp/view/pair-symposium2017/home">conference</a></li> </ul> <h5 id="question-of-the-week">Question of the week</h5> <p>“Is there a gcp service that’s cloud identity-aware proxy except for a static site that you host via cloud storage?”</p> <ul> <li><a href="https://twitter.com/kf/status/963195282434408448">Answer</a> between <a href="https://twitter.com/Neurotic">Mark</a> & <a href="https://github.com/kf">KF</a></li> <li>Cloud Identity-Aware Proxy <a href="https://cloud.google.com/iap/">site</a> & <a href="https://cloud.google.com/iap/docs/">docs</a></li> <li>Cloud Storage <a href="https://cloud.google.com/storage/">site</a> & <a href="https://cloud.google.com/storage/docs/">docs</a></li> <li>Hosting a Static Website on Cloud Storage <a href="https://cloud.google.com/storage/docs/hosting-static-website">site</a></li> <li>Google App Engine <a href="https://cloud.google.com/appengine/">site</a> & <a href="https://cloud.google.com/appengine/docs/">docs</a></li> <li>weasel <a href="https://github.com/google/weasel">repo</a></li> </ul> <h5 id="where-can-you-find-us-next">Where can you find us next?</h5> <p>Melanie will be at <a href="https://fatconference.org/">Fat*</a> in New York in Feb.</p> <p>Mark will be at the <a href="http://www.gdconf.com/">Game Developer’s Conference | GDC</a> in March.</p>