mohaali / nealetl Goto Github PK

after updating the version the issue on failing while retrieving data disappears however only a limited number of data are insert in the DB

Before update
Processing: 2/18/2019 9:37:24 PM
Making 2123 requests.

One or more errors occurred.
Creating SP.
CreateSP: Opening connection.
CreateSP: Created Command.
CreateSP: Opened connection.
CreateSP: Executing query.
CreateSP: Created.
RunStoredProc: Opening connection.
RunStoredProc: Connection Opened.
RunStoredProc: Running query.
RunStoredProc: Proc Executed.
RunStoredProc: Closing Connection
RunStoredProc: Connection Closed.
Processing: 2/18/2019 9:37:24 PM completed.
Exception while executing function: Functions.AuditPull
Microsoft.Azure.WebJobs.Host.FunctionInvocationException : Exception while executing function: Functions.AuditPull ---> System.Reflection.TargetInvocationException : Exception has been thrown by the target of an invocation. ---> System.AggregateException : One or more errors occurred. ---> The best overloaded method match for 'System.Collections.Generic.List.Contains(long)' has some invalid arguments
at Submission#0.Run(TimerInfo pbiTimer,TraceWriter log) at D:\home\site\wwwroot\AuditPull\run.csx : 33
---> (Inner Exception #0) Microsoft.CSharp.RuntimeBinder.RuntimeBinderException : The best overloaded method match for 'System.Collections.Generic.List.Contains(long)' has some invalid arguments
at CallSite.Target(Closure ,CallSite ,List1 ,Object ) at System.Dynamic.UpdateDelegates.UpdateAndExecute2[T0,T1,TRet](CallSite site,T0 arg0,T1 arg1) at CallSite.Target(Closure ,CallSite ,List1 ,Object )
at O365ETL.UserDataRetriever.<>c__DisplayClass9_0.b__0(Content content)
at System.Threading.Tasks.Parallel.<>c__DisplayClass31_02.<ForEachWorker>b__0(Int32 i) at System.Threading.Tasks.Parallel.<>c__DisplayClass17_01.b__1()
at System.Threading.Tasks.Task.InnerInvoke()
at System.Threading.Tasks.Task.InnerInvokeWithArg(Task childTask)
at System.Threading.Tasks.Task.<>c__DisplayClass176_0.b__0(Object )<---

---> (Inner Exception #1) Microsoft.…

After update

start: 2/19/2019 8:44:49 PM
DaysToRetrieve: 2
Processing: 2/17/2019 12:00:00 AM
51575003-f411-43b8-aed5-8c4b2f054cc5: Created new HTTPClient.
PLS: 20190219204453 : Running : [0/0|0/0]
PLS: 20190219204453 : Running : [0/0|0/0]
PLS: 20190219204453 : Running : [0/0|0/400]
PLS: 20190219204453 : Finished : [0/5|438/784]
PLS: 20190219204453 : Finished : [0/7|784/784]
PLS: 20190219204453 : Finished : [7/7|784/784]
Processing: 2/17/2019 12:00:00 AM completed.
Processing: 2/18/2019 12:00:00 AM
Processing: 2/18/2019 12:00:00 AM completed.
Processing: 2/19/2019 12:00:00 AM
Processing: 2/19/2019 12:00:00 AM completed.

DB query
SELECT top 1000
CONVERT(varchar, CREATIONTIME, 12) as [Date],
[WORKLOAD]
,Count(*) as Total
FROM adtlog.[20_PowerBI]
GROUP BY CONVERT(varchar, CREATIONTIME, 12) , [WORKLOAD]
ORDER BY [Date] DESC

Result

DATE | WORKLOAD | TOTAL
190219 | PowerBI | 281

Checking O365 Audit log I have more that 8k events