pquery

This is a collection of functions written in the M language for use in Microsoft Excel's Power Query plugin.

Introduction

Rather than manually adding the functions to different Excel workbooks, users can instead leave their files in any directory, and either batch import them into your workbook using Excel 2016 VBA (see my sample workbook here), or by dynamically loading them into Power Query using something like the Load() function (see Load.pq). To use Load() you'll need to add it to every applicable workbook though. You can hard-code in the path to the folder where you put the functions from this repository, or set it in the specified cell in the above-mentioned sample workbook for use in that.

To manually add the Load query, click 'From Other Sources' in the Power Query ribbon tab, select 'Blank Query' (bottom option), open the Advanced Editor in the View tab, and paste in the below snippet (after adjusting file path). Click Done, name the query 'Load', and click 'Apply & Close' in the Home tab.

If you have your M queries in files, you may well prefer to edit them from a text editor like Notepad++. With Matt Mason's language file for this you will get nice color coding too!

The main point here is that by separating universally useful functions from an individual workbook, you will feel encouraged to use more modular code, solving each common sub-problem only once, rather than remaining stuck in 'vanilla' M and resolving the same problems repeatedly.

Moreover, coding this way will also further facilitate sharing code with other Power Query users, allowing for a more collaborative environment.

Admittedly, Microsoft languages have rarely been known for encouraging open-source collaboration, and the Power Query community is currently small. But will that mean we cannot assemble a powerful code library like those of the JavaScript community?

Usage

to use M code in workbooks without having to import every query/function:

get and unzip this repo, or in case you'd like to contribute back, open a command prompt in your desired location (in Windows Explorer type cmd in the address bar) and run command git clone https://github.com/KiaraGrouwstra/pquery.git.
copy LoadPath.example.pq as LoadPath.pq and replace its entire content with the path where you put the query files; e.g. "D:\pquery\".
manually import the Load.pq and LoadPath.pq functions into your workbook, keeping their names as Load and LoadPath.
now use the Load function to load queries from the folder you specified. i.e. if you write Text_Between = Load("Text.Between"),, it's going to give you the function located at YOUR_PATH\Text.Between.pq.

to allow sharing your workbook:

use my Power Query workbook (requires Excel 2016) to batch import the desired queries into your workbook. Chris Webb also posted the used VBA code, and did an introductory blog post about it.

Related Projects (feel free to add!)

Power-BI-Desktop-Query-Extensions - newer library including in-app function documentation
PowerQueryExtensions - library using the recent DataConnectors API to expose the functions from this and the above library
m-tools - functional programming helpers
PowerQueryFunctional - DataConnectors port of the above library
atom-language-m - Atom support for M
LibPQ - a collection of reusable modules for Power Query M Language

For more Power Query related repos check out some of the following users (sorted alphabetically, feel free to add!):

Name		Name	Last commit message	Last commit date
Latest commit History 286 Commits
.gitignore		.gitignore
ByD.GetReportData.pq		ByD.GetReportData.pq
ByD.GetReportDataIDs.pq		ByD.GetReportDataIDs.pq
ByD.GetReportMetadataIdName.pq		ByD.GetReportMetadataIdName.pq
CrossUsage.pq		CrossUsage.pq
Date.EndOfLastMonth.pq		Date.EndOfLastMonth.pq
Date.EpochToDate.pq		Date.EpochToDate.pq
Date.FormatSQL.pq		Date.FormatSQL.pq
Date.NDaysAgo.pq		Date.NDaysAgo.pq
Date.NDaysInFuture.pq		Date.NDaysInFuture.pq
Date.StartOfCurrentYear.pq		Date.StartOfCurrentYear.pq
Date.StartOfLastYear.pq		Date.StartOfLastYear.pq
Date.StartOfMonth12MAgoExcCurMonth.pq		Date.StartOfMonth12MAgoExcCurMonth.pq
Date.StartOfMonth12MAgoIncCurMonth.pq		Date.StartOfMonth12MAgoIncCurMonth.pq
Date.Today.pq		Date.Today.pq
Date.Tomorrow.pq		Date.Tomorrow.pq
Date.Yesterday.pq		Date.Yesterday.pq
DateTime.FormatSQL.pq		DateTime.FormatSQL.pq
DateTime.UnixTime.pq		DateTime.UnixTime.pq
F.pq		F.pq
Files.SheetsInFolder.pq		Files.SheetsInFolder.pq
Function.Profile.pq		Function.Profile.pq
LICENSE		LICENSE
List.CrossJoin.pq		List.CrossJoin.pq
List.Dates.HolidaysRU.pq		List.Dates.HolidaysRU.pq
List.Dates.LastNDays.pq		List.Dates.LastNDays.pq
List.Dates.LastNYears.pq		List.Dates.LastNYears.pq
List.Dates.LastNYearsAndCurYear.pq		List.Dates.LastNYearsAndCurYear.pq
List.Dates.NYearsToDate.pq		List.Dates.NYearsToDate.pq
List.Dates.R12MExcCurMonth.pq		List.Dates.R12MExcCurMonth.pq
List.Dates.R12MIncCurMonthToDate.pq		List.Dates.R12MIncCurMonthToDate.pq
List.Dates.YTD.pq		List.Dates.YTD.pq
List.Dates.YTDLastYear.pq		List.Dates.YTDLastYear.pq
List.DatesBetween.pq		List.DatesBetween.pq
List.FlatMap.pq		List.FlatMap.pq
List.RankDense.pq		List.RankDense.pq
List.RankEqual.pq		List.RankEqual.pq
List.RemoveErrors.pq		List.RemoveErrors.pq
List.RemoveErrorsV2.pq		List.RemoveErrorsV2.pq
List.ReplaceErrors.pq		List.ReplaceErrors.pq
List.ToRecord.pq		List.ToRecord.pq
List.ToText.pq		List.ToText.pq
List.Zip.pq		List.Zip.pq
Load.pq		Load.pq
LoadFunctionFromGithub.pq		LoadFunctionFromGithub.pq
LoadPath.example.pq		LoadPath.example.pq
LoadTrace.pq		LoadTrace.pq
M.UDFs.pq		M.UDFs.pq
M.constants.pq		M.constants.pq
M.functions.pq		M.functions.pq
M.library.pq		M.library.pq
M.types.pq		M.types.pq
Misc.Wait.pq		Misc.Wait.pq
Number.Dec2Bin.pq		Number.Dec2Bin.pq
Old.Load.pq		Old.Load.pq
README.md		README.md
Record.Rename.pq		Record.Rename.pq
Record.Transform.pq		Record.Transform.pq
Record.TransformJoin.pq		Record.TransformJoin.pq
Stat.Trend.pq		Stat.Trend.pq
Table.AddScrape.pq		Table.AddScrape.pq
Table.CrossJoin.pq		Table.CrossJoin.pq
Table.CrossJoinTables.pq		Table.CrossJoinTables.pq
Table.ExpandAll.pq		Table.ExpandAll.pq
Table.ExpandRecords.pq		Table.ExpandRecords.pq
Table.ExpandTables.pq		Table.ExpandTables.pq
Table.ExpandTablesRecursive.pq		Table.ExpandTablesRecursive.pq
Table.FromString.pq		Table.FromString.pq
Table.JoinMany.pq		Table.JoinMany.pq
Table.MergeColumns.pq		Table.MergeColumns.pq
Table.RemoveBlankColumns.pq		Table.RemoveBlankColumns.pq
Table.RowsCombination.pq		Table.RowsCombination.pq
Table.RowsCombination2.pq		Table.RowsCombination2.pq
Table.TranslateColumn.pq		Table.TranslateColumn.pq
Table.UnpivotByNumbers.pq		Table.UnpivotByNumbers.pq
Text.AsciiOnly.pq		Text.AsciiOnly.pq
Text.Between.pq		Text.Between.pq
Text.ContainsAny.pq		Text.ContainsAny.pq
Text.Count.pq		Text.Count.pq
Text.EachBetween.pq		Text.EachBetween.pq
Text.EachFromTo.pq		Text.EachFromTo.pq
Text.FromTo.pq		Text.FromTo.pq
Text.Like.pq		Text.Like.pq
Text.MixedSort.pq		Text.MixedSort.pq
Text.PowerTrim.pq		Text.PowerTrim.pq
Text.Queries.pq		Text.Queries.pq
Text.RemoveSymbols.pq		Text.RemoveSymbols.pq
Text.ReplaceAll.pq		Text.ReplaceAll.pq
Time.EpochToTime.pq		Time.EpochToTime.pq
Type.ToText.pq		Type.ToText.pq
UdfContents.pq		UdfContents.pq
Value.ToText.pq		Value.ToText.pq
Value.TypeToText.pq		Value.TypeToText.pq
Value.WaitFor.pq		Value.WaitFor.pq
Vlookup.pq		Vlookup.pq
Web.ContentsCustomRetry.pq		Web.ContentsCustomRetry.pq
Web.Curl.pq		Web.Curl.pq
Web.FetchSequentially.pq		Web.FetchSequentially.pq
Web.Scrape.pq		Web.Scrape.pq
Web.TimeAndDateCom.GetCountries.pq		Web.TimeAndDateCom.GetCountries.pq

License

KiaraGrouwstra/pquery

Folders and files

Latest commit

History