Power query and old school
170 likes | 307 Vues
Learn all about Power Query, M Language, and data harvesting in XML format with insights from Julie Smith and Rob Volk, SQL Server experts. Discover tools, functions, and resources for powerful data analysis in Excel.
Power query and old school
E N D
Presentation Transcript
Power query and old school Harvesting xml data
Julie smith • Data Services Consultant at Innovative Architects in Atlanta, GA • One half of the DatachiX.com with Audrey Hammonds • SQL Server mvp • @juliechix • Always forget to upload my materials • Not today! http://sdrv.ms/LtBcxF
rob volk • Rob Volk is a database administrator from the Atlanta, Georgia area • Blogs at weblogs.sqlteam.com/robv • @sql_r • Former mvp
Today’s agenda • Story of how annoyed rob was with planning sql Saturdays • Has to be a better way • Foraging for data—on speakers, venues, strange coincidences • Power query –first came out as data explorer • Curl • Querying XML with SQL (transact sql to be exact)
IntroducingPower Query • Released july 2013 • Excel add-in for 2010 or 2013 • Self service etl!!
Power bi suite • Powerpivot – in memory embedded data models • Powermap • Power view – presentation ready visualizations • Power query • All in excel !!!!
Power bi • Office 365 • Data management gateway • Collaborate with office 365 sharepoint • http://office.microsoft.com/en-us/office365-sharepoint-online-enterprise-help/power-bi-admin-center-help-HA104078330.aspx
History • M Language for business analysts • Project oslo • Domain specific language • M has morphed into the power query for excel formula language • Download a pdf here: http://go.microsoft.com/fwlink/?LinkID=320633
It can harvest the following: • “other” • Sharepoint list, • Windows Azure marketplace, • any hadoop file (hdfs), • hdinsight, • active directory, • facebook. • Exchange ** New • RDBMS: sql server, azure sql server, access (oops), oracle, db2, mysql, postgress, teradata • File: • excel, csv, txt, , XML, JSON, folder (metadata) • From the intarwebz! • Write an M or power query formula language query yourself from scratch
sources • Regular sources—most database platforms including hadoop • Files—all types • Odata • Web site tables! • Active directory!
Functions • Transformation! • Merge (join on key) • Append—combine sources to new destination
Create your own function Goes To symbol
Resources • http://office.microsoft.com/en-us/excel-help/learn-about-data-explorer-formulas-HA104003958.aspx Formula cheat sheet • Great post by datapighttp://datapigtechnologies.com/blog/index.php/cool-things-you-can-do-with-data-explorer/ • On M language: http://blogs.msdn.com/b/modelcitizen/archive/2010/09/22/update-on-sql-server-modeling-ctp-repository-modeling-services-quot-quadrant-quot-and-quot-m-quot.aspx • M language specs from Microsoft: http://msdn.microsoft.com/en-us/library/dd285271.aspx • http://blogs.msdn.com/b/mlanguage/ • Downloadable 200 page doc on formula language (M) http://go.microsoft.com/fwlink/?LinkID=235474&clcid=0x409
Resources from Rob (more recent) • https://social.technet.microsoft.com/Forums/en-US/0f9fec02-4469-4c56-92ec-00d46b26b3fc/how-to-automateparameterizeloop-power-query?forum=powerquery • http://www.mattmasson.com/2014/04/defining-configurable-settings-for-your-queries/ • https://office.microsoft.com/en-us/excel-help/learn-about-data-explorer-formulas-HA104003958.aspx • https://office.microsoft.com/en-us/excel-help/power-query-formula-categories-HA104122363.aspx?CTT=5&origin=HA104003958http://thatmsftbiguy.com/powerqueryexcel/