Leveraging GitHub: Advanced Data Mining and User Profiling

We present this course in two parts:

• August 30th, 8 AM to 9 AM Pacific - Part 1
• August 31st, 8 AM to 9 AM Pacific - Part 2

A practical course tailored for individuals interested in capitalizing on the wealth of data within GitHub's extensive user base. You will learn how to effectively use Google X-Ray to find user profiles and understand the limitations of Google's search capabilities. The course also explores how to use third-party tools for in-depth data mining.

The class guides conducting comprehensive searches, covering topics from analyzing user mentions and companies, locating non-English profiles, and conducting advanced searches. You'll learn to use GitHub API tokens, run scripts, and retrieve user data. Techniques to find emails in commits and search by nickname are also covered.

Finally, the course discusses the broader ecosystem, including StackOverflow, Gitlab, and Bitbucket. It emphasizes the development of Custom Search Engines (CSEs) for GitHub and other platforms, including writing regular expressions for efficient email search. This course is a roadmap to unlocking the rich data resources in GitHub and beyond.

·   What is Github?

·   458 Million Visitors

·   Data in Github Profiles

·   Google X-Ray Github for Users

·   What Google Does Not Find

·   Ossinsight.io

·   User's Mentions and Companies

·   Company Details

·   Non-English Locations

·   Other Search Operators

·   Advanced Search Page

·   Emails in Commits

·   Search by Nickname

·   AmazingHiring

·   Find Emails

·   Trending Developers

·   Use Github Operators to Find Resumes

·   X-Ray - Instant Data Scraper Results

·   Collect the "Gems"

·       Custom Search Engines (CSEs)

·       How to Create a Github CSE

·       Search for Emails with Regular Expressions

·       Find Emails in Commits

·       Let's Search Tool

·       Get Github API Token

o   Give Permissions to Run Scripts

o   Search for Users

o   Get Users Data

o   Get Logins By Email

o   The Main Language

·       Nickname Enumeration

·       Gitlab X-Ray

·       Bitbucket

·       StackOverflow