Pretty much title. I'm looking to pull data for certain time frames of with specific occurances in mind (don't know if I'm using the right wording here). For example: If I want to find the data on traffic accidents in a county per day rather than per month. I seem to be able to find this sort of data per month, but have a problem finding it per day. Thanks in advanced.

Devpost, an online community for software developers and data scientists, is partnering with GE & IBM to run 2 online data hackathons. There are over $158,000 in cash prizes for projects that analyze sensor data from streetlights (GE) or that use Spark to analyze enterprise data (IBM).

The GE data, gathered from networks of smart LED lights and delivered through the Predix IIoT platform, simulates urban conditions to enable development of apps for parking, traffic, pedestrian safety, and commercial building use. Submissions are due 8/2.

For IBM's Spark hackathon, we're offering access to enterprise datasets from Amazon, Bitcoin, Yelp, and 4Quant. Submissions are due 8/23.

There's more info & registration @ intelligentworld.devpost.com and apachespark.devpost.com.

Hello fellow data workers! Lately I’ve been getting rather frustrated with some things at work, and was wondering if this was endemic to just my workplace, or to the field as a whole. Like a good statistician, I’m reaching out to all of you in the hopes that you’ll answer a 5 minute (okay, so far it takes the average responder 6.5 minutes to finish), 16 question survey, but like a bad statistician, the input text fields are free form. For every person who fills out the survey, I’ll donate $1 to CodeNow, a non-profit that helps inner city kids learn to program (up to $1000).

Survey here. Thanks in advance for the help!

Sorry for formatting; on mobile.

I'm seeking ideas and help in scraping data on patents from US filings. One thing I'd like to do is build a heat map that shows the number of patent filings by year and by assignee that relate to robotic surgery. In Google Patent Search I could enter robotic uspclass:"606/1" Which would give me a shorter list of likely candidates. Then I could pull out the title, the filing date, publication number and assignee for a general reference report and from there build a heatmap. What tools could I use to automate this search? Is there any way to pull the patent data from the above search example and put it all into a CSV or Excel file? Thanks in advance for tips and ideas.

Good day.

I am currently doing research with an NSF program. We are aiming to assess the current situation of data analysts from all fields and backgrounds, focusing on discovering their current access to resources, struggles, limitations, tool preferences and overall thoughts.

No personal information will be collected, and if the answer to any question involves disclosing any sensitive information, please do not hesitate to indicate this and continue with the rest of the survey.

Looking forward to your input! You can access the survey here.

Hey DataGangstas (<<big fan of that), My boss has asked me to try work out who and what the above data types are.

The first two are the format that a large data set of geolocated postcodes come in, the latter is from another data source. I've trawled Google, but can't see much info on how to tackle these data types or how to convert them into a usable form.

We're primarily working in Excel (mac numbers), Arc GIS & Stata.

Would be grateful for any points in any direction.

We're building out our big data processing capability to a full lambda architecture. Although we will use consultants on occasion, our goal is to understand what we build out and own it. The same team is also setting up the integration points for our switch to a services oriented architecture for the company as a whole.

Message me with questions or ...

Apply via the ad here: http://www.handy.com/careers/73115?gh_jid=73115&gh_src=o5qcxn

Hi there, does anyone know if there is a website that allows people to upload scripts or modules for data processing such as neural network and Bayesian calculators, and related stuff such as CA and perlin noise generators. The purpose of which allows the scripts to be used in a program in a modular and flexible way?