数据写入不到HDFS about chunjun

[yangsishu]

有报错，贴下报错信息；你可以用local模式可以本地debug 的

[zhihui-ge]

是用的local模式跑的，没有看到报错信息，下面是全部的日志信息
16:25:33.316 [main] INFO com.dtstack.flinkx.loader.DTClassLoader - urls=[file:/data/tmp/gezhihui/flinkx/plugins/common/flinkx-rdb.jar, file:/data/tmp/gezhihui/flinkx/plugins/httpreader/flinkx-http-reader.jar]
16:25:33.383 [main] INFO org.apache.flink.api.java.typeutils.TypeExtractor - class org.apache.flink.types.Row does not contain a getter for field fields
16:25:33.383 [main] INFO org.apache.flink.api.java.typeutils.TypeExtractor - class org.apache.flink.types.Row does not contain a setter for field fields
16:25:33.383 [main] INFO org.apache.flink.api.java.typeutils.TypeExtractor - class org.apache.flink.types.Row is not a valid POJO type because not all fields are valid POJO fields.
16:25:33.453 [main] INFO com.dtstack.flinkx.loader.DTClassLoader - urls=[file:/data/tmp/gezhihui/flinkx/plugins/common/flinkx-rdb.jar, file:/data/tmp/gezhihui/flinkx/plugins/hdfswriter/flinkx-hdfs-writer.jar]
src class: class com.google.gson.internal.LinkedTreeMap
16:25:33.513 [main] DEBUG org.apache.flink.streaming.api.graph.StreamGraphGenerator - Transforming SinkTransformation{id=3, name='hdfswriter', outputType=GenericType<java.lang.Object>, parallelism=1}
16:25:33.513 [main] DEBUG org.apache.flink.streaming.api.graph.StreamGraphGenerator - Transforming PartitionTransformation{id=2, name='Partition', outputType=GenericType<org.apache.flink.types.Row>, parallelism=1}
16:25:33.514 [main] DEBUG org.apache.flink.streaming.api.graph.StreamGraphGenerator - Transforming SourceTransformation{id=1, name='httpreader', outputType=GenericType<org.apache.flink.types.Row>, parallelism=1}
16:25:33.526 [main] DEBUG org.apache.flink.streaming.api.graph.StreamGraph - Vertex: 1
16:25:33.539 [main] DEBUG org.apache.flink.streaming.api.graph.StreamGraph - Vertex: 3
16:25:33.559 [main] DEBUG org.apache.flink.streaming.api.graph.StreamGraphHasherV2 - Generated hash 'bc764cd8ddf7a0cff126f51c16239658' for node 'Source: httpreader-1' {id: 1, parallelism: 1, user function: org.apache.flink.streaming.api.functions.source.InputFormatSourceFunction}
16:25:33.559 [main] DEBUG org.apache.flink.streaming.api.graph.StreamGraphHasherV2 - Generated hash '0a448493b4782967b150582570326227' for node 'Sink: hdfswriter-3' {id: 3, parallelism: 1, user function: org.apache.flink.streaming.api.functions.sink.OutputFormatSinkFunction}
16:25:33.630 [main] DEBUG org.apache.flink.streaming.api.graph.StreamingJobGraphGenerator - Parallelism set: 1 for 3
16:25:33.657 [main] DEBUG org.apache.flink.streaming.api.graph.StreamingJobGraphGenerator - Parallelism set: 1 for 1
16:25:33.669 [main] DEBUG org.apache.flink.streaming.api.graph.StreamingJobGraphGenerator - CONNECTED: RebalancePartitioner - 1 -> 3
16:25:33.678 [main] INFO org.apache.flink.streaming.api.environment.LocalStreamEnvironment - Running job on local embedded Flink mini cluster
16:25:34.070 [main] INFO org.apache.flink.runtime.minicluster.FlinkMiniCluster - Starting FlinkMiniCluster.
16:25:34.081 [main] INFO org.apache.flink.runtime.metrics.MetricRegistryImpl - No metrics reporter configured, no metrics will be exposed/reported.
16:25:34.751 [flink-akka.actor.default-dispatcher-4] INFO akka.event.slf4j.Slf4jLogger - Slf4jLogger started
16:25:34.770 [flink-akka.actor.default-dispatcher-4] DEBUG akka.event.EventStream - logger log1-Slf4jLogger started
16:25:34.777 [flink-akka.actor.default-dispatcher-4] DEBUG akka.event.EventStream - Default Loggers started
16:25:34.785 [main] DEBUG org.apache.flink.runtime.jobmanager.JobManager - No archive directory was configured. Jobs will not be archived.
16:25:34.798 [main] INFO org.apache.flink.runtime.blob.BlobServer - Created BLOB server storage directory /tmp/blobStore-6f0af2cd-99ff-4c9d-9167-5dd59435d0c3
16:25:34.811 [main] DEBUG org.apache.flink.util.NetUtils - Trying to open socket on port 0
16:25:34.816 [main] INFO org.apache.flink.runtime.blob.BlobServer - Started BLOB server at 0.0.0.0:44308 - max concurrent requests: 50 - max backlog: 1000
16:25:34.924 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmanager.MemoryArchivist - Started memory archivist akka://flink/user/archive_1
16:25:34.926 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmanager.JobManager - Starting JobManager at akka://flink/user/jobmanager_1.
16:25:34.926 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService - Proposing leadership to contender org.apache.flink.runtime.jobmanager.JobManager@2eee2719 @ akka://flink/user/jobmanager_1
16:25:34.930 [main] INFO org.apache.flink.runtime.taskexecutor.TaskManagerConfiguration - Messages have a max timeout of 10000 ms
16:25:34.935 [main] INFO org.apache.flink.runtime.taskexecutor.TaskManagerServices - Temporary file directory '/tmp': total 19 GB, usable 4 GB (21.05% usable)
16:25:34.973 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmanager.JobManager - JobManager akka://flink/user/jobmanager_1 was granted leadership with leader session ID Some(a2c293a0-79b3-48dc-bfd9-ab56bb9f2953).
16:25:34.977 [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService - Received confirmation of leadership for leader akka://flink/user/jobmanager_1 , session=a2c293a0-79b3-48dc-bfd9-ab56bb9f2953
16:25:34.981 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.runtime.clusterframework.standalone.StandaloneResourceManager - Received new leading JobManager akka://flink/user/jobmanager_1. Connecting.
16:25:34.997 [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.clusterframework.standalone.StandaloneResourceManager - Trying to associate with JobManager leader akka://flink/user/jobmanager_1
16:25:35.053 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmanager.JobManager - Resource manager registration: RegisterResourceManager akka://flink/user/resourcemanager_1
16:25:35.059 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.clusterframework.standalone.StandaloneResourceManager - Resource Manager associating with leading JobManager Actor[akka://flink/user/jobmanager_1#782735531] - leader session a2c293a0-79b3-48dc-bfd9-ab56bb9f2953
16:25:35.130 [main] INFO org.apache.flink.runtime.io.network.buffer.NetworkBufferPool - Allocated 173 MB for network buffer pool (number of memory segments: 5561, bytes per segment: 32768).
16:25:35.155 [main] INFO org.apache.flink.runtime.io.network.NetworkEnvironment - Starting the network environment and its components.
16:25:35.155 [main] DEBUG org.apache.flink.runtime.io.network.NetworkEnvironment - Starting network connection manager
16:25:35.155 [main] DEBUG org.apache.flink.queryablestate.server.KvStateServerImpl - Attempting to start Queryable State Server on port 9067.
16:25:35.174 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.logging.InternalLoggerFactory - Using SLF4J as the default logging framework
16:25:35.179 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent0 - java.nio.Buffer.address: available
16:25:35.179 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent0 - sun.misc.Unsafe.theUnsafe: available
16:25:35.179 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent0 - sun.misc.Unsafe.copyMemory: available
16:25:35.180 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent0 - java.nio.Bits.unaligned: true
16:25:35.180 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent - Java version: 8
16:25:35.180 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent - -Dio.netty.noUnsafe: false
16:25:35.180 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent - sun.misc.Unsafe: available
16:25:35.181 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent - -Dio.netty.noJavassist: false
16:25:35.253 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent - Javassist: available
16:25:35.253 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent - -Dio.netty.tmpdir: /tmp (java.io.tmpdir)
16:25:35.253 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent - -Dio.netty.bitMode: 64 (sun.arch.data.model)
16:25:35.254 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent - -Dio.netty.noPreferDirect: false
16:25:35.254 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator - -Dio.netty.allocator.numHeapArenas: 4
16:25:35.254 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator - -Dio.netty.allocator.numDirectArenas: 4
16:25:35.254 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator - -Dio.netty.allocator.pageSize: 8192
16:25:35.254 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator - -Dio.netty.allocator.maxOrder: 11
16:25:35.254 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator - -Dio.netty.allocator.chunkSize: 16777216
16:25:35.254 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator - -Dio.netty.allocator.tinyCacheSize: 512
16:25:35.254 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator - -Dio.netty.allocator.smallCacheSize: 256
16:25:35.254 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator - -Dio.netty.allocator.normalCacheSize: 64
16:25:35.254 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator - -Dio.netty.allocator.maxCachedBufferCapacity: 32768
16:25:35.254 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator - -Dio.netty.allocator.cacheTrimInterval: 8192
16:25:35.267 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.channel.MultithreadEventLoopGroup - -Dio.netty.eventLoopThreads: 8
16:25:35.286 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.channel.nio.NioEventLoop - -Dio.netty.noKeySetOptimization: false
16:25:35.286 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.channel.nio.NioEventLoop - -Dio.netty.selectorAutoRebuildThreshold: 512
16:25:35.328 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.ThreadLocalRandom - -Dio.netty.initialSeedUniquifier: 0x249b7c4c72d3bec7 (took 0 ms)
16:25:35.347 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.ByteBufUtil - -Dio.netty.allocator.type: unpooled
16:25:35.348 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.ByteBufUtil - -Dio.netty.threadLocalDirectBufferSize: 65536
16:25:35.352 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.NetUtil - Loopback interface: lo (lo, 127.0.0.1)
16:25:35.353 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.NetUtil - /proc/sys/net/core/somaxconn: 128
16:25:35.366 [main] INFO org.apache.flink.queryablestate.server.KvStateServerImpl - Started Queryable State Server @ /127.0.0.1:9067.
16:25:35.367 [main] DEBUG org.apache.flink.queryablestate.client.proxy.KvStateClientProxyImpl - Attempting to start Queryable State Proxy Server on port 9069.
16:25:35.375 [main] INFO org.apache.flink.queryablestate.client.proxy.KvStateClientProxyImpl - Started Queryable State Proxy Server @ /127.0.0.1:9069.
16:25:35.376 [main] INFO org.apache.flink.runtime.taskexecutor.TaskManagerServices - Limiting managed memory to 547 MB, memory will be allocated lazily.
16:25:35.383 [main] INFO org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager uses directory /tmp/flink-io-93ceaf40-c3b7-46e0-8200-761af6bec966 for spill files.
16:25:35.390 [main] INFO org.apache.flink.runtime.filecache.FileCache - User file cache uses directory /tmp/flink-dist-cache-c9878091-f11d-4bf3-8da4-8ba205fde678
16:25:35.409 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.filecache.FileCache - User file cache uses directory /tmp/flink-dist-cache-016fd94b-96e2-4557-b8da-9b3fccda6fd1
16:25:35.422 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskmanager.TaskManager - Starting TaskManager actor at akka://flink/user/taskmanager_1#-740439112.
16:25:35.423 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskmanager.TaskManager - TaskManager data connection information: 06a915d582a70b5a935ba60c5343add9 @ localhost (dataPort=-1)
16:25:35.424 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskmanager.TaskManager - TaskManager has 1 task slot(s).
16:25:35.426 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskmanager.TaskManager - Memory usage stats: [HEAP: 185/353/1746 MB, NON HEAP: 30/31/-1 MB (used/committed/max)]
16:25:35.439 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskmanager.TaskManager - Trying to register at JobManager akka://flink/user/jobmanager_1 (attempt 1, timeout: 500 milliseconds)
16:25:35.441 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.jobmanager.JobManager - RegisterTaskManager: RegisterTaskManager(06a915d582a70b5a935ba60c5343add9,06a915d582a70b5a935ba60c5343add9 @ localhost (dataPort=-1),cores=4, physMem=8235884544, heap=1830813696, managed=573571072,1)
16:25:35.442 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.clusterframework.standalone.StandaloneResourceManager - TaskManager 06a915d582a70b5a935ba60c5343add9 has started.
16:25:35.446 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.instance.InstanceManager - Registered TaskManager at localhost (akka://flink/user/taskmanager_1) as f034a0f97b783005c385dd2f104bcd7a. Current number of registered hosts is 1. Current number of alive task slots is 1.
16:25:35.451 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskmanager.TaskManager - Successful registration at JobManager (akka://flink/user/jobmanager_1), starting network stack and library cache.
16:25:35.457 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskmanager.TaskManager - Determined BLOB server address to be localhost/127.0.0.1:44308. Starting BLOB cache.
16:25:35.460 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.blob.PermanentBlobCache - Created BLOB cache storage directory /tmp/blobStore-2327ebe2-d315-4ad5-b24c-5881849e0c5f
16:25:35.463 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.blob.TransientBlobCache - Created BLOB cache storage directory /tmp/blobStore-27470115-7101-4415-9297-96b1a794f56a
16:25:35.481 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.client.JobSubmissionClientActor - Received SubmitJobAndWait(JobGraph(jobId: f2504ecd1c1c34b7ce0ff7c72d1ea7b9)) but there is no connection to a JobManager yet.
16:25:35.482 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.client.JobSubmissionClientActor - Received job default_job_id (f2504ecd1c1c34b7ce0ff7c72d1ea7b9).
16:25:35.482 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.client.JobSubmissionClientActor - Disconnect from JobManager null.
16:25:35.486 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.client.JobSubmissionClientActor - Connect to JobManager Actor[akka://flink/user/jobmanager_1#782735531].
16:25:35.487 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.client.JobSubmissionClientActor - Connected to JobManager at Actor[akka://flink/user/jobmanager_1#782735531] with leader session id a2c293a0-79b3-48dc-bfd9-ab56bb9f2953.
Connected to JobManager at Actor[akka://flink/user/jobmanager_1#782735531] with leader session id a2c293a0-79b3-48dc-bfd9-ab56bb9f2953.
16:25:35.487 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.client.JobSubmissionClientActor - Sending message to JobManager akka://flink/user/jobmanager_1 to submit job default_job_id (f2504ecd1c1c34b7ce0ff7c72d1ea7b9) and wait for progress
16:25:35.493 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.client.JobSubmissionClientActor - Upload jar files to job manager akka://flink/user/jobmanager_1.
16:25:35.506 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.client.JobSubmissionClientActor - Submit job to the job manager akka://flink/user/jobmanager_1.
16:25:35.509 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmanager.JobManager - Submitting job f2504ecd1c1c34b7ce0ff7c72d1ea7b9 (default_job_id).
16:25:35.521 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmanager.JobManager - Using restart strategy NoRestartStrategy for f2504ecd1c1c34b7ce0ff7c72d1ea7b9.
16:25:35.552 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job recovers via failover strategy: full graph restart
16:25:35.633 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmanager.JobManager - Running initialization on master for job default_job_id (f2504ecd1c1c34b7ce0ff7c72d1ea7b9).
16:25:35.644 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmanager.JobManager - Successfully ran initialization on master in 11 ms.
16:25:35.644 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.jobmanager.JobManager - Adding 2 vertices from job graph default_job_id (f2504ecd1c1c34b7ce0ff7c72d1ea7b9).
16:25:35.645 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.executiongraph.ExecutionGraph - Attaching 2 topologically sorted vertices to existing job graph with 0 vertices and 0 intermediate results.
16:25:35.665 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.executiongraph.ExecutionGraph - Connecting ExecutionJobVertex bc764cd8ddf7a0cff126f51c16239658 (Source: httpreader) to 0 predecessors.
16:25:35.666 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.executiongraph.ExecutionGraph - Connecting ExecutionJobVertex 0a448493b4782967b150582570326227 (Sink: hdfswriter) to 1 predecessors.
16:25:35.666 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.executiongraph.ExecutionGraph - Connecting input 0 of vertex 0a448493b4782967b150582570326227 (Sink: hdfswriter) to intermediate result referenced via predecessor bc764cd8ddf7a0cff126f51c16239658 (Source: httpreader).
16:25:35.667 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.jobmanager.JobManager - Successfully created execution graph from job graph default_job_id (f2504ecd1c1c34b7ce0ff7c72d1ea7b9).
16:25:35.679 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.jobmanager.JobManager - No state backend has been configured, using default state backend (Memory / JobManager)
16:25:35.697 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.client.JobSubmissionClientActor - Job f2504ecd1c1c34b7ce0ff7c72d1ea7b9 was successfully submitted to the JobManager akka://flink/deadLetters.
16:25:35.697 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmanager.JobManager - Scheduling job f2504ecd1c1c34b7ce0ff7c72d1ea7b9 (default_job_id).
16:25:35.697 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job default_job_id (f2504ecd1c1c34b7ce0ff7c72d1ea7b9) switched from state CREATED to RUNNING.
16:25:35.699 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.client.JobSubmissionClientActor - 06/22/2018 16:25:35 Job execution switched to status RUNNING.
06/22/2018 16:25:35 Job execution switched to status RUNNING.
16:25:35.700 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: httpreader (1/1) (19de5cfffdedef62d5bb0e98272f5945) switched from CREATED to SCHEDULED.
16:25:35.702 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.client.JobSubmissionClientActor - 06/22/2018 16:25:35 Source: httpreader(1/1) switched to SCHEDULED
06/22/2018 16:25:35 Source: httpreader(1/1) switched to SCHEDULED
16:25:35.707 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmanager.scheduler.Scheduler - Scheduling task {task=Source: httpreader (1/1) - execution #0, sharingUnit=SlotSharingGroup [0a448493b4782967b150582570326227, bc764cd8ddf7a0cff126f51c16239658], locationConstraint=null}
16:25:35.714 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmanager.scheduler.Scheduler - Unconstrained assignment: Source: httpreader (1/1) --> SimpleSlot (0)(0) - 06a915d582a70b5a935ba60c5343add9 @ localhost (dataPort=-1) - ALLOCATED/ALIVE
16:25:35.716 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: hdfswriter (1/1) (74a7993bfa6a0f5aaa1a22e1af4431f9) switched from CREATED to SCHEDULED.
16:25:35.716 [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.client.JobSubmissionClientActor - 06/22/2018 16:25:35 Sink: hdfswriter(1/1) switched to SCHEDULED
06/22/2018 16:25:35 Sink: hdfswriter(1/1) switched to SCHEDULED
16:25:35.718 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmanager.scheduler.Scheduler - Scheduling task {task=Sink: hdfswriter (1/1) - execution #0, sharingUnit=SlotSharingGroup [0a448493b4782967b150582570326227, bc764cd8ddf7a0cff126f51c16239658], locationConstraint=null}
16:25:35.719 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmanager.scheduler.Scheduler - Local assignment: Sink: hdfswriter (1/1) --> SimpleSlot (0)(1) - 06a915d582a70b5a935ba60c5343add9 @ localhost (dataPort=-1) - ALLOCATED/ALIVE
16:25:35.722 [mini-cluster-future-thread-1] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: httpreader (1/1) (19de5cfffdedef62d5bb0e98272f5945) switched from SCHEDULED to DEPLOYING.
16:25:35.722 [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.client.JobSubmissionClientActor - 06/22/2018 16:25:35 Source: httpreader(1/1) switched to DEPLOYING
16:25:35.722 [mini-cluster-future-thread-1] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying Source: httpreader (1/1) (attempt #0) to localhost
06/22/2018 16:25:35 Source: httpreader(1/1) switched to DEPLOYING
16:25:35.732 [mini-cluster-future-thread-1] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: hdfswriter (1/1) (74a7993bfa6a0f5aaa1a22e1af4431f9) switched from SCHEDULED to DEPLOYING.
16:25:35.733 [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.client.JobSubmissionClientActor - 06/22/2018 16:25:35 Sink: hdfswriter(1/1) switched to DEPLOYING
06/22/2018 16:25:35 Sink: hdfswriter(1/1) switched to DEPLOYING
16:25:35.733 [mini-cluster-future-thread-1] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying Sink: hdfswriter (1/1) (attempt #0) to localhost
16:25:35.770 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.io.network.partition.ResultPartition - Source: httpreader (1/1) (19de5cfffdedef62d5bb0e98272f5945): Initialized ResultPartition 5138ff5ce3ce45c8a039d84147487211@19de5cfffdedef62d5bb0e98272f5945 [PIPELINED_BOUNDED, 1 subpartitions, 1 pending references]
16:25:35.781 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskmanager.TaskManager - Received task Source: httpreader (1/1)
16:25:35.781 [Source: httpreader (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: httpreader (1/1) (19de5cfffdedef62d5bb0e98272f5945) switched from CREATED to DEPLOYING.
16:25:35.782 [Source: httpreader (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task Source: httpreader (1/1) (19de5cfffdedef62d5bb0e98272f5945) [DEPLOYING]
16:25:35.791 [Source: httpreader (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task Source: httpreader (1/1) (19de5cfffdedef62d5bb0e98272f5945) [DEPLOYING].
16:25:35.792 [Source: httpreader (1/1)] DEBUG org.apache.flink.runtime.taskmanager.Task - Getting user code class loader for task 19de5cfffdedef62d5bb0e98272f5945 at library cache manager took 0 milliseconds
16:25:35.792 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate - Created 1 input channels (local: 1, remote: 0, unknown: 0).
16:25:35.793 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskmanager.TaskManager - Received task Sink: hdfswriter (1/1)
16:25:35.793 [Sink: hdfswriter (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Sink: hdfswriter (1/1) (74a7993bfa6a0f5aaa1a22e1af4431f9) switched from CREATED to DEPLOYING.
16:25:35.793 [Sink: hdfswriter (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task Sink: hdfswriter (1/1) (74a7993bfa6a0f5aaa1a22e1af4431f9) [DEPLOYING]
16:25:35.794 [Sink: hdfswriter (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task Sink: hdfswriter (1/1) (74a7993bfa6a0f5aaa1a22e1af4431f9) [DEPLOYING].
16:25:35.798 [Source: httpreader (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: Source: httpreader (1/1) (19de5cfffdedef62d5bb0e98272f5945) [DEPLOYING].
16:25:35.803 [Source: httpreader (1/1)] DEBUG org.apache.flink.runtime.io.network.buffer.LocalBufferPool - Using a local buffer pool with 1-10 buffers
16:25:35.804 [Source: httpreader (1/1)] DEBUG org.apache.flink.runtime.io.network.partition.ResultPartitionManager - Registered ResultPartition 5138ff5ce3ce45c8a039d84147487211@19de5cfffdedef62d5bb0e98272f5945 [PIPELINED_BOUNDED, 1 subpartitions, 1 pending references].
16:25:35.809 [Source: httpreader (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: httpreader (1/1) (19de5cfffdedef62d5bb0e98272f5945) switched from DEPLOYING to RUNNING.
16:25:35.812 [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: httpreader (1/1) (19de5cfffdedef62d5bb0e98272f5945) switched from DEPLOYING to RUNNING.
16:25:35.812 [Source: httpreader (1/1)] DEBUG org.apache.flink.streaming.runtime.tasks.StreamTask - Initializing Source: httpreader (1/1).
16:25:35.812 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.client.JobSubmissionClientActor - 06/22/2018 16:25:35 Source: httpreader(1/1) switched to RUNNING
06/22/2018 16:25:35 Source: httpreader(1/1) switched to RUNNING
16:25:35.814 [Source: httpreader (1/1)] INFO org.apache.flink.streaming.runtime.tasks.StreamTask - No state backend has been configured, using default state backend (Memory / JobManager)
16:25:35.835 [Sink: hdfswriter (1/1)] DEBUG org.apache.flink.runtime.taskmanager.Task - Getting user code class loader for task 74a7993bfa6a0f5aaa1a22e1af4431f9 at library cache manager took 41 milliseconds
16:25:35.835 [Source: httpreader (1/1)] DEBUG org.apache.flink.streaming.runtime.tasks.OperatorChain - Using partitioner REBALANCE for output 0 of task
16:25:35.837 [Sink: hdfswriter (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: Sink: hdfswriter (1/1) (74a7993bfa6a0f5aaa1a22e1af4431f9) [DEPLOYING].
16:25:35.837 [Sink: hdfswriter (1/1)] DEBUG org.apache.flink.runtime.io.network.buffer.LocalBufferPool - Using a local buffer pool with 1-10 buffers
16:25:35.837 [Sink: hdfswriter (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Sink: hdfswriter (1/1) (74a7993bfa6a0f5aaa1a22e1af4431f9) switched from DEPLOYING to RUNNING.
16:25:35.838 [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: hdfswriter (1/1) (74a7993bfa6a0f5aaa1a22e1af4431f9) switched from DEPLOYING to RUNNING.
16:25:35.838 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.client.JobSubmissionClientActor - 06/22/2018 16:25:35 Sink: hdfswriter(1/1) switched to RUNNING
06/22/2018 16:25:35 Sink: hdfswriter(1/1) switched to RUNNING
16:25:35.838 [Sink: hdfswriter (1/1)] DEBUG org.apache.flink.streaming.runtime.tasks.StreamTask - Initializing Sink: hdfswriter (1/1).
16:25:35.841 [Sink: hdfswriter (1/1)] INFO org.apache.flink.streaming.runtime.tasks.StreamTask - No state backend has been configured, using default state backend (Memory / JobManager)
16:25:35.860 [Source: httpreader (1/1)] DEBUG org.apache.flink.streaming.runtime.tasks.StreamTask - Invoking Source: httpreader (1/1)
16:25:35.871 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.api.common.io.DefaultInputSplitAssigner - No more input splits available
16:25:35.871 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmanager.JobManager - Send next input split null.
16:25:35.891 [Sink: hdfswriter (1/1)] DEBUG org.apache.flink.streaming.runtime.tasks.StreamTask - Invoking Sink: hdfswriter (1/1)
16:25:35.956 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - TaskManager was triggered to register at JobManager, but is already registered
16:25:36.276 [Source: httpreader (1/1)] INFO com.dtstack.flinkx.http.reader.HttpInputFormat - subtask input close finished
16:25:36.276 [Source: httpreader (1/1)] DEBUG org.apache.flink.streaming.runtime.tasks.StreamTask - Finished task Source: httpreader (1/1)
16:25:36.276 [Source: httpreader (1/1)] INFO com.dtstack.flinkx.http.reader.HttpInputFormat - subtask input close finished
16:25:36.279 [Source: httpreader (1/1)] DEBUG org.apache.flink.streaming.runtime.tasks.StreamTask - Closed operators for task Source: httpreader (1/1)
16:25:36.297 [Source: httpreader (1/1)] DEBUG org.apache.flink.runtime.io.network.partition.PipelinedSubpartition - Finished PipelinedSubpartition [number of buffers: 2 (25 bytes), finished? true, read view? false].
16:25:36.298 [Source: httpreader (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: httpreader (1/1) (19de5cfffdedef62d5bb0e98272f5945) switched from RUNNING to FINISHED.
16:25:36.298 [Source: httpreader (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: httpreader (1/1) (19de5cfffdedef62d5bb0e98272f5945).
16:25:36.298 [Source: httpreader (1/1)] DEBUG org.apache.flink.runtime.io.network.NetworkEnvironment - Unregister task Source: httpreader (1/1) from network environment (state: FINISHED).
16:25:36.298 [Source: httpreader (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: httpreader (1/1) (19de5cfffdedef62d5bb0e98272f5945) [FINISHED]
16:25:36.306 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.taskmanager.TaskManager - Un-registering task and sending final execution state FINISHED to JobManager for task Source: httpreader (19de5cfffdedef62d5bb0e98272f5945)
16:25:36.322 [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: httpreader (1/1) (19de5cfffdedef62d5bb0e98272f5945) switched from RUNNING to FINISHED.
16:25:36.322 [flink-akka.actor.default-dispatcher-5] DEBUG org.apache.flink.runtime.instance.SlotSharingGroupAssignment - Release simple slot SimpleSlot (0)(0) - 06a915d582a70b5a935ba60c5343add9 @ localhost (dataPort=-1) - RELEASED.
16:25:36.323 [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.client.JobSubmissionClientActor - 06/22/2018 16:25:36 Source: httpreader(1/1) switched to FINISHED
06/22/2018 16:25:36 Source: httpreader(1/1) switched to FINISHED
16:25:40.477 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
16:25:45.476 [flink-akka.actor.default-dispatcher-5] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
16:25:50.476 [flink-akka.actor.default-dispatcher-5] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
16:25:52.474 [Sink: hdfswriter (1/1)] INFO com.dtstack.flinkx.hdfs.writer.HdfsTextOutputFormat - subtask[0] close()
16:25:55.476 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
16:26:00.476 [flink-akka.actor.default-dispatcher-5] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
16:26:05.476 [flink-akka.actor.default-dispatcher-5] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
16:26:10.476 [flink-akka.actor.default-dispatcher-5] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
16:26:15.476 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
16:26:20.476 [flink-akka.actor.default-dispatcher-5] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
16:26:25.475 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
16:26:30.476 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
16:26:35.476 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
16:26:40.475 [flink-akka.actor.default-dispatcher-5] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
16:26:45.475 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
16:26:50.476 [flink-akka.actor.default-dispatcher-5] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
16:26:55.475 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
16:27:00.476 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
16:27:05.476 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
16:27:10.476 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
16:27:15.476 [flink-akka.actor.default-dispatcher-5] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
16:27:20.475 [flink-akka.actor.default-dispatcher-5] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
16:27:25.476 [flink-akka.actor.default-dispatcher-5] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
16:27:30.476 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
16:27:35.476 [flink-akka.actor.default-dispatcher-5] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
16:27:40.476 [flink-akka.actor.default-dispatcher-5] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
16:27:45.475 [flink-akka.actor.default-dispatcher-5] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
16:27:50.476 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
16:27:55.476 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
16:28:00.475 [flink-akka.actor.default-dispatcher-5] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
16:28:05.476 [flink-akka.actor.default-dispatcher-5] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
16:28:10.476 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
16:28:15.476 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
16:28:20.476 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
16:28:25.475 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
16:28:30.476 [flink-akka.actor.default-dispatcher-5] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
16:28:35.476 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
18:59:26.806 [main] INFO com.dtstack.flinkx.loader.DTClassLoader - urls=[file:/data/tmp/gezhihui/flinkx/plugins/common/flinkx-rdb.jar, file:/data/tmp/gezhihui/flinkx/plugins/httpreader/flinkx-http-reader.jar]
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/data/tmp/gezhihui/flinkx/lib/flinkx-launcher-1.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/data/tmp/gezhihui/flinkx/plugins/httpreader/flinkx-http-reader.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [ch.qos.logback.classic.util.ContextSelectorStaticBinder]
18:59:26.885 [main] INFO com.dtstack.flinkx.http.reader.HttpReader - ====httpUrl == xxxxxxx
18:59:26.934 [main] INFO org.apache.flink.api.java.typeutils.TypeExtractor - class org.apache.flink.types.Row does not contain a getter for field fields
18:59:26.935 [main] INFO org.apache.flink.api.java.typeutils.TypeExtractor - class org.apache.flink.types.Row does not contain a setter for field fields
18:59:26.935 [main] INFO org.apache.flink.api.java.typeutils.TypeExtractor - class org.apache.flink.types.Row is not a valid POJO type because not all fields are valid POJO fields.
18:59:27.003 [main] INFO com.dtstack.flinkx.loader.DTClassLoader - urls=[file:/data/tmp/gezhihui/flinkx/plugins/common/flinkx-rdb.jar, file:/data/tmp/gezhihui/flinkx/plugins/hdfswriter/flinkx-hdfs-writer.jar]
src class: class com.google.gson.internal.LinkedTreeMap
18:59:27.062 [main] DEBUG org.apache.flink.streaming.api.graph.StreamGraphGenerator - Transforming SinkTransformation{id=3, name='hdfswriter', outputType=GenericType<java.lang.Object>, parallelism=1}
18:59:27.062 [main] DEBUG org.apache.flink.streaming.api.graph.StreamGraphGenerator - Transforming PartitionTransformation{id=2, name='Partition', outputType=GenericType<org.apache.flink.types.Row>, parallelism=1}
18:59:27.063 [main] DEBUG org.apache.flink.streaming.api.graph.StreamGraphGenerator - Transforming SourceTransformation{id=1, name='httpreader', outputType=GenericType<org.apache.flink.types.Row>, parallelism=1}
18:59:27.073 [main] DEBUG org.apache.flink.streaming.api.graph.StreamGraph - Vertex: 1
18:59:27.086 [main] DEBUG org.apache.flink.streaming.api.graph.StreamGraph - Vertex: 3
18:59:27.106 [main] DEBUG org.apache.flink.streaming.api.graph.StreamGraphHasherV2 - Generated hash 'bc764cd8ddf7a0cff126f51c16239658' for node 'Source: httpreader-1' {id: 1, parallelism: 1, user function: org.apache.flink.streaming.api.functions.source.InputFormatSourceFunction}
18:59:27.106 [main] DEBUG org.apache.flink.streaming.api.graph.StreamGraphHasherV2 - Generated hash '0a448493b4782967b150582570326227' for node 'Sink: hdfswriter-3' {id: 3, parallelism: 1, user function: org.apache.flink.streaming.api.functions.sink.OutputFormatSinkFunction}
18:59:27.179 [main] DEBUG org.apache.flink.streaming.api.graph.StreamingJobGraphGenerator - Parallelism set: 1 for 3
18:59:27.205 [main] DEBUG org.apache.flink.streaming.api.graph.StreamingJobGraphGenerator - Parallelism set: 1 for 1
18:59:27.217 [main] DEBUG org.apache.flink.streaming.api.graph.StreamingJobGraphGenerator - CONNECTED: RebalancePartitioner - 1 -> 3
18:59:27.225 [main] INFO org.apache.flink.streaming.api.environment.LocalStreamEnvironment - Running job on local embedded Flink mini cluster
18:59:27.678 [main] INFO org.apache.flink.runtime.minicluster.FlinkMiniCluster - Starting FlinkMiniCluster.
18:59:27.688 [main] INFO org.apache.flink.runtime.metrics.MetricRegistryImpl - No metrics reporter configured, no metrics will be exposed/reported.
18:59:28.361 [flink-akka.actor.default-dispatcher-2] INFO akka.event.slf4j.Slf4jLogger - Slf4jLogger started
18:59:28.380 [flink-akka.actor.default-dispatcher-2] DEBUG akka.event.EventStream - logger log1-Slf4jLogger started
18:59:28.384 [flink-akka.actor.default-dispatcher-2] DEBUG akka.event.EventStream - Default Loggers started
18:59:28.395 [main] DEBUG org.apache.flink.runtime.jobmanager.JobManager - No archive directory was configured. Jobs will not be archived.
18:59:28.409 [main] INFO org.apache.flink.runtime.blob.BlobServer - Created BLOB server storage directory /tmp/blobStore-d936e1d4-5200-42b4-807b-027eba74454c
18:59:28.421 [main] DEBUG org.apache.flink.util.NetUtils - Trying to open socket on port 0
18:59:28.427 [main] INFO org.apache.flink.runtime.blob.BlobServer - Started BLOB server at 0.0.0.0:36250 - max concurrent requests: 50 - max backlog: 1000
18:59:28.584 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmanager.MemoryArchivist - Started memory archivist akka://flink/user/archive_1
18:59:28.587 [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.jobmanager.JobManager - Starting JobManager at akka://flink/user/jobmanager_1.
18:59:28.588 [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService - Proposing leadership to contender org.apache.flink.runtime.jobmanager.JobManager@42035aa9 @ akka://flink/user/jobmanager_1
18:59:28.594 [main] INFO org.apache.flink.runtime.taskexecutor.TaskManagerConfiguration - Messages have a max timeout of 10000 ms
18:59:28.601 [main] INFO org.apache.flink.runtime.taskexecutor.TaskManagerServices - Temporary file directory '/tmp': total 19 GB, usable 4 GB (21.05% usable)
18:59:28.686 [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.jobmanager.JobManager - JobManager akka://flink/user/jobmanager_1 was granted leadership with leader session ID Some(9ed020bd-a706-45e7-881f-059aca8b2726).
18:59:28.692 [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService - Received confirmation of leadership for leader akka://flink/user/jobmanager_1 , session=9ed020bd-a706-45e7-881f-059aca8b2726
18:59:28.696 [flink-akka.actor.default-dispatcher-3] DEBUG org.apache.flink.runtime.clusterframework.standalone.StandaloneResourceManager - Received new leading JobManager akka://flink/user/jobmanager_1. Connecting.
18:59:28.718 [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.clusterframework.standalone.StandaloneResourceManager - Trying to associate with JobManager leader akka://flink/user/jobmanager_1
18:59:28.802 [flink-akka.actor.default-dispatcher-5] DEBUG org.apache.flink.runtime.jobmanager.JobManager - Resource manager registration: RegisterResourceManager akka://flink/user/resourcemanager_1
18:59:28.813 [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.clusterframework.standalone.StandaloneResourceManager - Resource Manager associating with leading JobManager Actor[akka://flink/user/jobmanager_1#1040851053] - leader session 9ed020bd-a706-45e7-881f-059aca8b2726
18:59:28.910 [main] INFO org.apache.flink.runtime.io.network.buffer.NetworkBufferPool - Allocated 173 MB for network buffer pool (number of memory segments: 5560, bytes per segment: 32768).
18:59:28.951 [main] INFO org.apache.flink.runtime.io.network.NetworkEnvironment - Starting the network environment and its components.
18:59:28.951 [main] DEBUG org.apache.flink.runtime.io.network.NetworkEnvironment - Starting network connection manager
18:59:28.951 [main] DEBUG org.apache.flink.queryablestate.server.KvStateServerImpl - Attempting to start Queryable State Server on port 9067.
18:59:28.980 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.logging.InternalLoggerFactory - Using SLF4J as the default logging framework
18:59:28.989 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent0 - java.nio.Buffer.address: available
18:59:28.989 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent0 - sun.misc.Unsafe.theUnsafe: available
18:59:28.990 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent0 - sun.misc.Unsafe.copyMemory: available
18:59:28.990 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent0 - java.nio.Bits.unaligned: true
18:59:28.991 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent - Java version: 8
18:59:28.991 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent - -Dio.netty.noUnsafe: false
18:59:28.992 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent - sun.misc.Unsafe: available
18:59:28.992 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent - -Dio.netty.noJavassist: false
18:59:29.115 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent - Javassist: available
18:59:29.115 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent - -Dio.netty.tmpdir: /tmp (java.io.tmpdir)
18:59:29.115 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent - -Dio.netty.bitMode: 64 (sun.arch.data.model)
18:59:29.116 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.PlatformDependent - -Dio.netty.noPreferDirect: false
18:59:29.116 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator - -Dio.netty.allocator.numHeapArenas: 4
18:59:29.116 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator - -Dio.netty.allocator.numDirectArenas: 4
18:59:29.116 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator - -Dio.netty.allocator.pageSize: 8192
18:59:29.116 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator - -Dio.netty.allocator.maxOrder: 11
18:59:29.116 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator - -Dio.netty.allocator.chunkSize: 16777216
18:59:29.117 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator - -Dio.netty.allocator.tinyCacheSize: 512
18:59:29.117 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator - -Dio.netty.allocator.smallCacheSize: 256
18:59:29.117 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator - -Dio.netty.allocator.normalCacheSize: 64
18:59:29.117 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator - -Dio.netty.allocator.maxCachedBufferCapacity: 32768
18:59:29.117 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.PooledByteBufAllocator - -Dio.netty.allocator.cacheTrimInterval: 8192
18:59:29.139 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.channel.MultithreadEventLoopGroup - -Dio.netty.eventLoopThreads: 8
18:59:29.171 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.channel.nio.NioEventLoop - -Dio.netty.noKeySetOptimization: false
18:59:29.171 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.channel.nio.NioEventLoop - -Dio.netty.selectorAutoRebuildThreshold: 512
18:59:29.232 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.internal.ThreadLocalRandom - -Dio.netty.initialSeedUniquifier: 0xb717869432a0f5b5 (took 0 ms)
18:59:29.263 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.ByteBufUtil - -Dio.netty.allocator.type: unpooled
18:59:29.263 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.buffer.ByteBufUtil - -Dio.netty.threadLocalDirectBufferSize: 65536
18:59:29.268 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.NetUtil - Loopback interface: lo (lo, 127.0.0.1)
18:59:29.268 [main] DEBUG org.apache.flink.shaded.netty4.io.netty.util.NetUtil - /proc/sys/net/core/somaxconn: 128
18:59:29.283 [main] INFO org.apache.flink.queryablestate.server.KvStateServerImpl - Started Queryable State Server @ /127.0.0.1:9067.
18:59:29.283 [main] DEBUG org.apache.flink.queryablestate.client.proxy.KvStateClientProxyImpl - Attempting to start Queryable State Proxy Server on port 9069.
18:59:29.292 [main] INFO org.apache.flink.queryablestate.client.proxy.KvStateClientProxyImpl - Started Queryable State Proxy Server @ /127.0.0.1:9069.
18:59:29.294 [main] INFO org.apache.flink.runtime.taskexecutor.TaskManagerServices - Limiting managed memory to 547 MB, memory will be allocated lazily.
18:59:29.302 [main] INFO org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager uses directory /tmp/flink-io-42c6a8c4-01a0-4295-bf72-8231c8111ea4 for spill files.
18:59:29.309 [main] INFO org.apache.flink.runtime.filecache.FileCache - User file cache uses directory /tmp/flink-dist-cache-cceef8c3-ea68-42a2-9463-31a4c746dc52
18:59:29.330 [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.filecache.FileCache - User file cache uses directory /tmp/flink-dist-cache-b8bdf5ad-a9ea-4cb5-aa39-3c01c19f00b7
18:59:29.346 [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskmanager.TaskManager - Starting TaskManager actor at akka://flink/user/taskmanager_1#-1127915154.
18:59:29.347 [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskmanager.TaskManager - TaskManager data connection information: b66c222807be61af44639fa9dcdc8514 @ localhost (dataPort=-1)
18:59:29.348 [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskmanager.TaskManager - TaskManager has 1 task slot(s).
18:59:29.350 [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskmanager.TaskManager - Memory usage stats: [HEAP: 188/354/1746 MB, NON HEAP: 31/32/-1 MB (used/committed/max)]
18:59:29.366 [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskmanager.TaskManager - Trying to register at JobManager akka://flink/user/jobmanager_1 (attempt 1, timeout: 500 milliseconds)
18:59:29.369 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmanager.JobManager - RegisterTaskManager: RegisterTaskManager(b66c222807be61af44639fa9dcdc8514,b66c222807be61af44639fa9dcdc8514 @ localhost (dataPort=-1),cores=4, physMem=8235884544, heap=1830813696, managed=573571072,1)
18:59:29.369 [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.clusterframework.standalone.StandaloneResourceManager - TaskManager b66c222807be61af44639fa9dcdc8514 has started.
18:59:29.374 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.instance.InstanceManager - Registered TaskManager at localhost (akka://flink/user/taskmanager_1) as e00f6ec9d816a30caf484642fb3eab15. Current number of registered hosts is 1. Current number of alive task slots is 1.
18:59:29.379 [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskmanager.TaskManager - Successful registration at JobManager (akka://flink/user/jobmanager_1), starting network stack and library cache.
18:59:29.385 [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.taskmanager.TaskManager - Determined BLOB server address to be localhost/127.0.0.1:36250. Starting BLOB cache.
18:59:29.390 [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.blob.PermanentBlobCache - Created BLOB cache storage directory /tmp/blobStore-b458c4e4-f9bb-4815-beaa-0879025fab70
18:59:29.394 [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.blob.TransientBlobCache - Created BLOB cache storage directory /tmp/blobStore-66716393-cfe5-4ffd-b1de-b3a7747dfea8
18:59:29.414 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.client.JobSubmissionClientActor - Received SubmitJobAndWait(JobGraph(jobId: 846e828ae9b394f24965c92a0f81a828)) but there is no connection to a JobManager yet.
18:59:29.415 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.client.JobSubmissionClientActor - Received job default_job_id (846e828ae9b394f24965c92a0f81a828).
18:59:29.415 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.client.JobSubmissionClientActor - Disconnect from JobManager null.
18:59:29.419 [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.client.JobSubmissionClientActor - Connect to JobManager Actor[akka://flink/user/jobmanager_1#1040851053].
18:59:29.419 [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.client.JobSubmissionClientActor - Connected to JobManager at Actor[akka://flink/user/jobmanager_1#1040851053] with leader session id 9ed020bd-a706-45e7-881f-059aca8b2726.
Connected to JobManager at Actor[akka://flink/user/jobmanager_1#1040851053] with leader session id 9ed020bd-a706-45e7-881f-059aca8b2726.
18:59:29.420 [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.client.JobSubmissionClientActor - Sending message to JobManager akka://flink/user/jobmanager_1 to submit job default_job_id (846e828ae9b394f24965c92a0f81a828) and wait for progress
18:59:29.426 [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.client.JobSubmissionClientActor - Upload jar files to job manager akka://flink/user/jobmanager_1.
18:59:29.440 [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.client.JobSubmissionClientActor - Submit job to the job manager akka://flink/user/jobmanager_1.
18:59:29.444 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmanager.JobManager - Submitting job 846e828ae9b394f24965c92a0f81a828 (default_job_id).
18:59:29.458 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmanager.JobManager - Using restart strategy NoRestartStrategy for 846e828ae9b394f24965c92a0f81a828.
18:59:29.489 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job recovers via failover strategy: full graph restart
18:59:29.580 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmanager.JobManager - Running initialization on master for job default_job_id (846e828ae9b394f24965c92a0f81a828).
18:59:29.591 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmanager.JobManager - Successfully ran initialization on master in 11 ms.
18:59:29.592 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmanager.JobManager - Adding 2 vertices from job graph default_job_id (846e828ae9b394f24965c92a0f81a828).
18:59:29.592 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.executiongraph.ExecutionGraph - Attaching 2 topologically sorted vertices to existing job graph with 0 vertices and 0 intermediate results.
18:59:29.615 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.executiongraph.ExecutionGraph - Connecting ExecutionJobVertex bc764cd8ddf7a0cff126f51c16239658 (Source: httpreader) to 0 predecessors.
18:59:29.615 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.executiongraph.ExecutionGraph - Connecting ExecutionJobVertex 0a448493b4782967b150582570326227 (Sink: hdfswriter) to 1 predecessors.
18:59:29.616 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.executiongraph.ExecutionGraph - Connecting input 0 of vertex 0a448493b4782967b150582570326227 (Sink: hdfswriter) to intermediate result referenced via predecessor bc764cd8ddf7a0cff126f51c16239658 (Source: httpreader).
18:59:29.617 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmanager.JobManager - Successfully created execution graph from job graph default_job_id (846e828ae9b394f24965c92a0f81a828).
18:59:29.630 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmanager.JobManager - No state backend has been configured, using default state backend (Memory / JobManager)
18:59:29.649 [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.client.JobSubmissionClientActor - Job 846e828ae9b394f24965c92a0f81a828 was successfully submitted to the JobManager akka://flink/deadLetters.
18:59:29.650 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.jobmanager.JobManager - Scheduling job 846e828ae9b394f24965c92a0f81a828 (default_job_id).
18:59:29.650 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Job default_job_id (846e828ae9b394f24965c92a0f81a828) switched from state CREATED to RUNNING.
18:59:29.652 [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.client.JobSubmissionClientActor - 07/04/2018 18:59:29 Job execution switched to status RUNNING.
07/04/2018 18:59:29 Job execution switched to status RUNNING.
18:59:29.653 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: httpreader (1/1) (16ac1fb0b1019a13e7bdb5d5826b1ba9) switched from CREATED to SCHEDULED.
18:59:29.654 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.client.JobSubmissionClientActor - 07/04/2018 18:59:29 Source: httpreader(1/1) switched to SCHEDULED
07/04/2018 18:59:29 Source: httpreader(1/1) switched to SCHEDULED
18:59:29.660 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmanager.scheduler.Scheduler - Scheduling task {task=Source: httpreader (1/1) - execution #0, sharingUnit=SlotSharingGroup [0a448493b4782967b150582570326227, bc764cd8ddf7a0cff126f51c16239658], locationConstraint=null}
18:59:29.668 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmanager.scheduler.Scheduler - Unconstrained assignment: Source: httpreader (1/1) --> SimpleSlot (0)(0) - b66c222807be61af44639fa9dcdc8514 @ localhost (dataPort=-1) - ALLOCATED/ALIVE
18:59:29.670 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: hdfswriter (1/1) (004bf1a64147a474e91d51ea9a99451b) switched from CREATED to SCHEDULED.
18:59:29.671 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.client.JobSubmissionClientActor - 07/04/2018 18:59:29 Sink: hdfswriter(1/1) switched to SCHEDULED
07/04/2018 18:59:29 Sink: hdfswriter(1/1) switched to SCHEDULED
18:59:29.672 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmanager.scheduler.Scheduler - Scheduling task {task=Sink: hdfswriter (1/1) - execution #0, sharingUnit=SlotSharingGroup [0a448493b4782967b150582570326227, bc764cd8ddf7a0cff126f51c16239658], locationConstraint=null}
18:59:29.673 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.jobmanager.scheduler.Scheduler - Local assignment: Sink: hdfswriter (1/1) --> SimpleSlot (0)(1) - b66c222807be61af44639fa9dcdc8514 @ localhost (dataPort=-1) - ALLOCATED/ALIVE
18:59:29.676 [mini-cluster-future-thread-1] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: httpreader (1/1) (16ac1fb0b1019a13e7bdb5d5826b1ba9) switched from SCHEDULED to DEPLOYING.
18:59:29.677 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.client.JobSubmissionClientActor - 07/04/2018 18:59:29 Source: httpreader(1/1) switched to DEPLOYING
18:59:29.677 [mini-cluster-future-thread-1] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying Source: httpreader (1/1) (attempt #0) to localhost
07/04/2018 18:59:29 Source: httpreader(1/1) switched to DEPLOYING
18:59:29.696 [mini-cluster-future-thread-1] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: hdfswriter (1/1) (004bf1a64147a474e91d51ea9a99451b) switched from SCHEDULED to DEPLOYING.
18:59:29.696 [mini-cluster-future-thread-1] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying Sink: hdfswriter (1/1) (attempt #0) to localhost
18:59:29.696 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.client.JobSubmissionClientActor - 07/04/2018 18:59:29 Sink: hdfswriter(1/1) switched to DEPLOYING
07/04/2018 18:59:29 Sink: hdfswriter(1/1) switched to DEPLOYING
18:59:29.726 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.io.network.partition.ResultPartition - Source: httpreader (1/1) (16ac1fb0b1019a13e7bdb5d5826b1ba9): Initialized ResultPartition cb11e2701653888dfca2f31fa20587a5@16ac1fb0b1019a13e7bdb5d5826b1ba9 [PIPELINED_BOUNDED, 1 subpartitions, 1 pending references]
18:59:29.738 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskmanager.TaskManager - Received task Source: httpreader (1/1)
18:59:29.739 [Source: httpreader (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: httpreader (1/1) (16ac1fb0b1019a13e7bdb5d5826b1ba9) switched from CREATED to DEPLOYING.
18:59:29.745 [Source: httpreader (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task Source: httpreader (1/1) (16ac1fb0b1019a13e7bdb5d5826b1ba9) [DEPLOYING]
18:59:29.751 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.io.network.partition.consumer.SingleInputGate - Created 1 input channels (local: 1, remote: 0, unknown: 0).
18:59:29.752 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskmanager.TaskManager - Received task Sink: hdfswriter (1/1)
18:59:29.752 [Source: httpreader (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task Source: httpreader (1/1) (16ac1fb0b1019a13e7bdb5d5826b1ba9) [DEPLOYING].
18:59:29.752 [Sink: hdfswriter (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Sink: hdfswriter (1/1) (004bf1a64147a474e91d51ea9a99451b) switched from CREATED to DEPLOYING.
18:59:29.753 [Source: httpreader (1/1)] DEBUG org.apache.flink.runtime.taskmanager.Task - Getting user code class loader for task 16ac1fb0b1019a13e7bdb5d5826b1ba9 at library cache manager took 1 milliseconds
18:59:29.753 [Sink: hdfswriter (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak safety net for task Sink: hdfswriter (1/1) (004bf1a64147a474e91d51ea9a99451b) [DEPLOYING]
18:59:29.753 [Sink: hdfswriter (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task Sink: hdfswriter (1/1) (004bf1a64147a474e91d51ea9a99451b) [DEPLOYING].
18:59:29.760 [Source: httpreader (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: Source: httpreader (1/1) (16ac1fb0b1019a13e7bdb5d5826b1ba9) [DEPLOYING].
18:59:29.769 [Source: httpreader (1/1)] DEBUG org.apache.flink.runtime.io.network.buffer.LocalBufferPool - Using a local buffer pool with 1-10 buffers
18:59:29.770 [Sink: hdfswriter (1/1)] DEBUG org.apache.flink.runtime.taskmanager.Task - Getting user code class loader for task 004bf1a64147a474e91d51ea9a99451b at library cache manager took 17 milliseconds
18:59:29.770 [Source: httpreader (1/1)] DEBUG org.apache.flink.runtime.io.network.partition.ResultPartitionManager - Registered ResultPartition cb11e2701653888dfca2f31fa20587a5@16ac1fb0b1019a13e7bdb5d5826b1ba9 [PIPELINED_BOUNDED, 1 subpartitions, 1 pending references].
18:59:29.773 [Sink: hdfswriter (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Registering task at network: Sink: hdfswriter (1/1) (004bf1a64147a474e91d51ea9a99451b) [DEPLOYING].
18:59:29.773 [Sink: hdfswriter (1/1)] DEBUG org.apache.flink.runtime.io.network.buffer.LocalBufferPool - Using a local buffer pool with 1-10 buffers
18:59:29.786 [Source: httpreader (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: httpreader (1/1) (16ac1fb0b1019a13e7bdb5d5826b1ba9) switched from DEPLOYING to RUNNING.
18:59:29.786 [Sink: hdfswriter (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Sink: hdfswriter (1/1) (004bf1a64147a474e91d51ea9a99451b) switched from DEPLOYING to RUNNING.
18:59:29.789 [Sink: hdfswriter (1/1)] DEBUG org.apache.flink.streaming.runtime.tasks.StreamTask - Initializing Sink: hdfswriter (1/1).
18:59:29.790 [flink-akka.actor.default-dispatcher-3] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: httpreader (1/1) (16ac1fb0b1019a13e7bdb5d5826b1ba9) switched from DEPLOYING to RUNNING.
18:59:29.790 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Sink: hdfswriter (1/1) (004bf1a64147a474e91d51ea9a99451b) switched from DEPLOYING to RUNNING.
18:59:29.790 [Sink: hdfswriter (1/1)] INFO org.apache.flink.streaming.runtime.tasks.StreamTask - No state backend has been configured, using default state backend (Memory / JobManager)
18:59:29.791 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.client.JobSubmissionClientActor - 07/04/2018 18:59:29 Source: httpreader(1/1) switched to RUNNING
07/04/2018 18:59:29 Source: httpreader(1/1) switched to RUNNING
18:59:29.791 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.client.JobSubmissionClientActor - 07/04/2018 18:59:29 Sink: hdfswriter(1/1) switched to RUNNING
07/04/2018 18:59:29 Sink: hdfswriter(1/1) switched to RUNNING
18:59:29.792 [Source: httpreader (1/1)] DEBUG org.apache.flink.streaming.runtime.tasks.StreamTask - Initializing Source: httpreader (1/1).
18:59:29.792 [Source: httpreader (1/1)] INFO org.apache.flink.streaming.runtime.tasks.StreamTask - No state backend has been configured, using default state backend (Memory / JobManager)
18:59:29.828 [Source: httpreader (1/1)] DEBUG org.apache.flink.streaming.runtime.tasks.OperatorChain - Using partitioner REBALANCE for output 0 of task
18:59:29.849 [Sink: hdfswriter (1/1)] DEBUG org.apache.flink.streaming.runtime.tasks.StreamTask - Invoking Sink: hdfswriter (1/1)
18:59:29.853 [Source: httpreader (1/1)] DEBUG org.apache.flink.streaming.runtime.tasks.StreamTask - Invoking Source: httpreader (1/1)
18:59:29.871 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.api.common.io.DefaultInputSplitAssigner - Assigning split GenericSplit (0/1) to localhost
18:59:29.872 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.jobmanager.JobManager - Send next input split GenericSplit (0/1).
18:59:29.886 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - TaskManager was triggered to register at JobManager, but is already registered
18:59:30.268 [Source: httpreader (1/1)] INFO com.dtstack.flinkx.http.reader.HttpInputFormat - ===getSplitNumber = 0
===================75702552,DT35,1,230,2018-07-04 09:56:55,0,0,d9045b79b10df4f0307c158619d3c139,U093,0,0,0,953,3,0,10,0,0,12,71,1,0,0,0,0,0,0,0,0,2447740,0,0,2,7,23,0,0,0,0,1,0,0,0,0,sti9v7jz7OHQ3PbO0f4=,514,0,1,0,4,1,100,0,0,
18:59:30.562 [Source: httpreader (1/1)] INFO com.dtstack.flinkx.http.reader.HttpInputFormat - subtask input close finished
18:59:30.563 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.api.common.io.DefaultInputSplitAssigner - No more input splits available
18:59:30.563 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.jobmanager.JobManager - Send next input split null.
18:59:30.563 [Source: httpreader (1/1)] INFO com.dtstack.flinkx.http.reader.HttpInputFormat - subtask input close finished
18:59:30.565 [Source: httpreader (1/1)] DEBUG org.apache.flink.streaming.runtime.tasks.StreamTask - Finished task Source: httpreader (1/1)
18:59:30.565 [Source: httpreader (1/1)] INFO com.dtstack.flinkx.http.reader.HttpInputFormat - subtask input close finished
18:59:30.566 [Source: httpreader (1/1)] DEBUG org.apache.flink.streaming.runtime.tasks.StreamTask - Closed operators for task Source: httpreader (1/1)
18:59:30.577 [Source: httpreader (1/1)] DEBUG org.apache.flink.runtime.io.network.partition.PipelinedSubpartition - Finished PipelinedSubpartition [number of buffers: 5 (59570 bytes), finished? true, read view? false].
18:59:30.577 [Source: httpreader (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Source: httpreader (1/1) (16ac1fb0b1019a13e7bdb5d5826b1ba9) switched from RUNNING to FINISHED.
18:59:30.577 [Source: httpreader (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task resources for Source: httpreader (1/1) (16ac1fb0b1019a13e7bdb5d5826b1ba9).
18:59:30.578 [Source: httpreader (1/1)] DEBUG org.apache.flink.runtime.io.network.NetworkEnvironment - Unregister task Source: httpreader (1/1) from network environment (state: FINISHED).
18:59:30.578 [Source: httpreader (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are closed for task Source: httpreader (1/1) (16ac1fb0b1019a13e7bdb5d5826b1ba9) [FINISHED]
18:59:30.579 [flink-akka.actor.default-dispatcher-4] INFO org.apache.flink.runtime.taskmanager.TaskManager - Un-registering task and sending final execution state FINISHED to JobManager for task Source: httpreader (16ac1fb0b1019a13e7bdb5d5826b1ba9)
18:59:30.598 [flink-akka.actor.default-dispatcher-2] INFO org.apache.flink.runtime.executiongraph.ExecutionGraph - Source: httpreader (1/1) (16ac1fb0b1019a13e7bdb5d5826b1ba9) switched from RUNNING to FINISHED.
18:59:30.598 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.instance.SlotSharingGroupAssignment - Release simple slot SimpleSlot (0)(0) - b66c222807be61af44639fa9dcdc8514 @ localhost (dataPort=-1) - RELEASED.
18:59:30.599 [flink-akka.actor.default-dispatcher-5] INFO org.apache.flink.runtime.client.JobSubmissionClientActor - 07/04/2018 18:59:30 Source: httpreader(1/1) switched to FINISHED
07/04/2018 18:59:30 Source: httpreader(1/1) switched to FINISHED
18:59:34.416 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
18:59:39.416 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
18:59:44.416 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
18:59:46.586 [Sink: hdfswriter (1/1)] INFO com.dtstack.flinkx.hdfs.writer.HdfsTextOutputFormat - subtask[0] close()
18:59:49.416 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
18:59:54.416 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
18:59:59.416 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:00:04.416 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:00:09.415 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:00:14.415 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:00:19.415 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:00:24.415 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:00:29.416 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:00:34.415 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:00:39.416 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:00:44.416 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:00:49.415 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:00:54.415 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:00:59.416 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:01:04.415 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:01:09.415 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:01:14.416 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:01:19.416 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:01:24.416 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:01:29.416 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:01:34.415 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:01:39.416 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:01:44.416 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:01:49.415 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:01:54.415 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:01:59.415 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:02:04.415 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:02:09.416 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:02:14.416 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:02:19.416 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:02:24.415 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:02:29.415 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:02:34.415 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:02:39.415 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:02:44.416 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:02:49.415 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:02:54.415 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:02:59.415 [flink-akka.actor.default-dispatcher-2] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:03:04.416 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:03:09.416 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:03:14.415 [flink-akka.actor.default-dispatcher-7] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:03:19.415 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:03:24.416 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:03:29.415 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:03:34.416 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:03:39.415 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:03:44.416 [flink-akka.actor.default-dispatcher-7] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:03:49.415 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:03:54.416 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:03:59.416 [flink-akka.actor.default-dispatcher-4] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:04:04.416 [flink-akka.actor.default-dispatcher-7] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:04:09.416 [flink-akka.actor.default-dispatcher-7] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:04:14.416 [flink-akka.actor.default-dispatcher-8] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:04:19.415 [flink-akka.actor.default-dispatcher-8] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:04:24.415 [flink-akka.actor.default-dispatcher-8] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:04:29.415 [flink-akka.actor.default-dispatcher-7] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:04:34.416 [flink-akka.actor.default-dispatcher-7] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:04:39.415 [flink-akka.actor.default-dispatcher-7] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:04:44.415 [flink-akka.actor.default-dispatcher-8] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:04:49.415 [flink-akka.actor.default-dispatcher-7] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:04:54.416 [flink-akka.actor.default-dispatcher-8] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:04:59.415 [flink-akka.actor.default-dispatcher-7] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:05:04.415 [flink-akka.actor.default-dispatcher-7] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:05:09.415 [flink-akka.actor.default-dispatcher-8] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:05:14.415 [flink-akka.actor.default-dispatcher-8] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:05:19.415 [flink-akka.actor.default-dispatcher-7] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:05:24.416 [flink-akka.actor.default-dispatcher-7] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:05:29.415 [flink-akka.actor.default-dispatcher-8] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:05:34.416 [flink-akka.actor.default-dispatcher-7] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:05:39.416 [flink-akka.actor.default-dispatcher-7] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:05:44.415 [flink-akka.actor.default-dispatcher-7] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:05:49.415 [flink-akka.actor.default-dispatcher-8] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:05:54.416 [flink-akka.actor.default-dispatcher-8] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:05:59.415 [flink-akka.actor.default-dispatcher-7] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:06:04.416 [flink-akka.actor.default-dispatcher-8] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:06:09.416 [flink-akka.actor.default-dispatcher-7] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:06:14.416 [flink-akka.actor.default-dispatcher-8] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:06:19.415 [flink-akka.actor.default-dispatcher-7] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:06:24.415 [flink-akka.actor.default-dispatcher-7] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:06:29.415 [flink-akka.actor.default-dispatcher-8] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:06:34.415 [flink-akka.actor.default-dispatcher-8] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:06:39.415 [flink-akka.actor.default-dispatcher-8] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:06:44.416 [flink-akka.actor.default-dispatcher-10] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:06:49.415 [flink-akka.actor.default-dispatcher-10] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:06:54.416 [flink-akka.actor.default-dispatcher-8] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:06:59.416 [flink-akka.actor.default-dispatcher-8] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:07:04.416 [flink-akka.actor.default-dispatcher-8] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:07:09.416 [flink-akka.actor.default-dispatcher-8] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:07:14.415 [flink-akka.actor.default-dispatcher-10] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:07:19.415 [flink-akka.actor.default-dispatcher-10] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:07:24.416 [flink-akka.actor.default-dispatcher-10] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:07:29.415 [flink-akka.actor.default-dispatcher-8] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:07:34.415 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:07:39.415 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:07:44.416 [flink-akka.actor.default-dispatcher-8] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:07:49.415 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:07:54.416 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:07:59.416 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:08:04.416 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:08:09.415 [flink-akka.actor.default-dispatcher-13] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:08:14.416 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:08:19.415 [flink-akka.actor.default-dispatcher-13] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:08:24.415 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:08:29.415 [flink-akka.actor.default-dispatcher-13] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:08:34.415 [flink-akka.actor.default-dispatcher-13] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:08:39.415 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:08:44.415 [flink-akka.actor.default-dispatcher-13] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:08:49.415 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:08:54.416 [flink-akka.actor.default-dispatcher-13] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:08:59.416 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:09:04.415 [flink-akka.actor.default-dispatcher-13] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:09:09.415 [flink-akka.actor.default-dispatcher-13] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:09:14.415 [flink-akka.actor.default-dispatcher-13] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:09:19.416 [flink-akka.actor.default-dispatcher-13] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:09:24.415 [flink-akka.actor.default-dispatcher-13] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:09:29.415 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:09:34.416 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:09:39.416 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:09:44.415 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:09:49.415 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:09:54.415 [flink-akka.actor.default-dispatcher-13] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:09:59.416 [flink-akka.actor.default-dispatcher-13] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:10:04.416 [flink-akka.actor.default-dispatcher-13] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:10:09.416 [flink-akka.actor.default-dispatcher-13] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:10:14.416 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:10:19.415 [flink-akka.actor.default-dispatcher-13] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:10:24.415 [flink-akka.actor.default-dispatcher-13] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:10:29.416 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:10:34.416 [flink-akka.actor.default-dispatcher-13] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:10:39.416 [flink-akka.actor.default-dispatcher-13] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:10:44.416 [flink-akka.actor.default-dispatcher-13] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:10:49.416 [flink-akka.actor.default-dispatcher-13] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:10:54.415 [flink-akka.actor.default-dispatcher-13] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:10:59.416 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:11:04.416 [flink-akka.actor.default-dispatcher-13] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:11:09.415 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:11:14.416 [flink-akka.actor.default-dispatcher-13] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:11:19.416 [flink-akka.actor.default-dispatcher-13] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:11:24.415 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:11:29.415 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:11:34.415 [flink-akka.actor.default-dispatcher-13] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:11:39.415 [flink-akka.actor.default-dispatcher-13] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:11:44.415 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:11:49.415 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:11:54.415 [flink-akka.actor.default-dispatcher-13] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:11:59.416 [flink-akka.actor.default-dispatcher-13] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:12:04.415 [flink-akka.actor.default-dispatcher-13] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:12:09.416 [flink-akka.actor.default-dispatcher-13] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:12:14.415 [flink-akka.actor.default-dispatcher-13] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:12:19.415 [flink-akka.actor.default-dispatcher-13] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:12:24.416 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:12:29.415 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:12:34.416 [flink-akka.actor.default-dispatcher-20] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:12:39.415 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:12:44.416 [flink-akka.actor.default-dispatcher-20] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:12:49.416 [flink-akka.actor.default-dispatcher-20] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:12:54.415 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:12:59.415 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:13:04.416 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:13:09.415 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:13:14.415 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:13:19.416 [flink-akka.actor.default-dispatcher-20] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:13:24.416 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:13:29.415 [flink-akka.actor.default-dispatcher-20] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:13:34.415 [flink-akka.actor.default-dispatcher-20] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:13:39.416 [flink-akka.actor.default-dispatcher-20] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:13:44.416 [flink-akka.actor.default-dispatcher-20] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:13:49.416 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:13:54.415 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:13:59.415 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:14:04.415 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:14:09.415 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:14:14.416 [flink-akka.actor.default-dispatcher-20] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:14:19.415 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:14:24.416 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:14:29.415 [flink-akka.actor.default-dispatcher-20] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:14:34.415 [flink-akka.actor.default-dispatcher-20] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:14:39.415 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:14:44.415 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:14:49.415 [flink-akka.actor.default-dispatcher-20] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:14:54.416 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:14:59.416 [flink-akka.actor.default-dispatcher-20] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:15:04.415 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:15:09.416 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:15:14.415 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:15:19.416 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:15:24.416 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:15:29.416 [flink-akka.actor.default-dispatcher-20] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:15:34.416 [flink-akka.actor.default-dispatcher-20] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:15:39.415 [flink-akka.actor.default-dispatcher-20] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:15:44.415 [flink-akka.actor.default-dispatcher-20] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:15:49.416 [flink-akka.actor.default-dispatcher-20] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:15:54.415 [flink-akka.actor.default-dispatcher-20] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:15:59.415 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:16:04.416 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:16:09.416 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:16:14.416 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:16:19.415 [flink-akka.actor.default-dispatcher-20] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:16:24.416 [flink-akka.actor.default-dispatcher-20] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:16:29.416 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:16:34.415 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:16:39.415 [flink-akka.actor.default-dispatcher-20] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:16:44.415 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:16:49.416 [flink-akka.actor.default-dispatcher-20] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:16:54.416 [flink-akka.actor.default-dispatcher-20] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:16:59.415 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:17:04.415 [flink-akka.actor.default-dispatcher-20] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:17:09.415 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:17:14.415 [flink-akka.actor.default-dispatcher-20] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:17:19.416 [flink-akka.actor.default-dispatcher-20] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:17:24.416 [flink-akka.actor.default-dispatcher-20] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:17:29.416 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:17:34.416 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:17:39.416 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:17:44.416 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:17:49.416 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:17:54.416 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:17:59.416 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:18:04.415 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:18:09.415 [flink-akka.actor.default-dispatcher-20] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:18:14.415 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:18:19.415 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:18:24.415 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:18:29.415 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:18:34.415 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:18:39.416 [flink-akka.actor.default-dispatcher-20] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:18:44.416 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:18:49.416 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:18:54.415 [flink-akka.actor.default-dispatcher-20] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:18:59.415 [flink-akka.actor.default-dispatcher-20] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:19:04.416 [flink-akka.actor.default-dispatcher-20] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:19:09.415 [flink-akka.actor.default-dispatcher-20] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:19:14.416 [flink-akka.actor.default-dispatcher-12] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:19:19.416 [flink-akka.actor.default-dispatcher-20] DEBUG org.apache.flink.runtime.taskmanager.TaskManager - Sending heartbeat to JobManager
19:19:19.976 [Thread-8] INFO org.apache.flink.runtime.blob.PermanentBlobCache - Shutting down BLOB cache
19:19:19.977 [I/O manager shutdown hook] DEBUG org.apache.flink.runtime.io.disk.iomanager.IOManager - Shutting down I/O manager.
19:19:19.978 [Thread-10] INFO org.apache.flink.runtime.blob.TransientBlobCache - Shutting down BLOB cache
19:19:19.994 [I/O manager shutdown hook] INFO org.apache.flink.runtime.io.disk.iomanager.IOManager - I/O manager removed spill file directory /tmp/flink-io-42c6a8c4-01a0-4295-bf72-8231c8111ea4
19:19:19.994 [Thread-2] INFO org.apache.flink.runtime.blob.BlobServer - Stopped BLOB server at 0.0.0.0:36250

[yangsishu]

你把你的数据同步任务json配置信息发下

[yangsishu]

你可以在hdfs写的地方打个断点看些，有没有到那个地方

[yangsishu]

还有你的代码是那个分支的

[zhihui-ge]

在master上开发的
{ "job": { "setting": { "speed": { "channel": 1, "bytes": 10000 }, "errorLimit": { "record": 0, "percentage": 50 } }, "content": [ { "reader": { "name": "httpreader", "parameter": { "httpUrl": "xxxxxxxxx", "column": [ { "index": 0 }, { "index": 1 }, { "index": 2 }, { "index": 3 }, { "index": 4 }, { "index": 5 }, { "index": 6 }, { "index": 7 }, { "index": 8 }, { "index": 9 }, { "index": 10 }, { "index": 11 }, { "index": 12 }, { "index": 13 }, { "index": 14 }, { "index": 15 }, { "index": 16 }, { "index": 17 }, { "index": 18 }, { "index": 19 }, { "index": 20 }, { "index": 21 }, { "index": 22 }, { "index": 23 }, { "index": 24 }, { "index": 25 }, { "index": 26 }, { "index": 27 }, { "index": 28 }, { "index": 29 }, { "index": 30 }, { "index": 31 }, { "index": 32 }, { "index": 33 }, { "index": 34 }, { "index": 35 }, { "index": 36 }, { "index": 37 }, { "index": 38 }, { "index": 39 }, { "index": 40 }, { "index": 41 }, { "index": 42 }, { "index": 43 }, { "index": 44 }, { "index": 45 }, { "index": 46 }, { "index": 47 }, { "index": 48 }, { "index": 49 }, { "index": 50 }, { "index": 51 }, { "index": 52 }, { "index": 53 }, { "index": 54 } ], "encoding": "UTF-8", "fieldDelimiter": "," } }, "writer": { "name": "hdfswriter", "parameter": { "hadoopConfig": { "dfs.nameservices": "DHTestCluster", "dfs.ha.namenodes.DHTestCluster": "nn1,nn2", "dfs.namenode.rpc-address.DHTestCluster.nn1": "hadoop1.test.yunwei.puppet.dh:8020", "dfs.namenode.rpc-address.DHTestCluster.nn2": "hadoop2.test.yunwei.puppet.dh:8020", "dfs.client.failover.proxy.DHTestCluster.ns1": "org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider" }, "defaultFS": "hdfs://DHTestCluster", "fileType": "text", "fileName": "hallo", "column": [ { "name": "co01", "type": "STRING" }, { "name": "co02", "type": "STRING" }, { "name": "co03", "type": "STRING" }, { "name": "co04", "type": "STRING" }, { "name": "co05", "type": "STRING" }, { "name": "co06", "type": "STRING" }, { "name": "co07", "type": "STRING" }, { "name": "co09", "type": "STRING" }, { "name": "col0", "type": "STRING" }, { "name": "col1", "type": "STRING" }, { "name": "col2", "type": "STRING" }, { "name": "col3", "type": "STRING" }, { "name": "col4", "type": "STRING" }, { "name": "col5", "type": "STRING" }, { "name": "col6", "type": "STRING" }, { "name": "col7", "type": "STRING" }, { "name": "col8", "type": "STRING" }, { "name": "col9", "type": "STRING" }, { "name": "co20", "type": "STRING" }, { "name": "co21", "type": "STRING" }, { "name": "co22", "type": "STRING" }, { "name": "co23", "type": "STRING" }, { "name": "co24", "type": "STRING" }, { "name": "co25", "type": "STRING" }, { "name": "co26", "type": "STRING" }, { "name": "co27", "type": "STRING" }, { "name": "co05", "type": "STRING" }, { "name": "co28", "type": "STRING" }, { "name": "co29", "type": "STRING" }, { "name": "co30", "type": "STRING" }, { "name": "co31", "type": "STRING" }, { "name": "co32", "type": "STRING" }, { "name": "co33", "type": "STRING" }, { "name": "co34", "type": "STRING" }, { "name": "co35", "type": "STRING" }, { "name": "co36", "type": "STRING" }, { "name": "co37", "type": "STRING" }, { "name": "co38", "type": "STRING" }, { "name": "co39", "type": "STRING" }, { "name": "co40", "type": "STRING" }, { "name": "co41", "type": "STRING" }, { "name": "co42", "type": "STRING" }, { "name": "co43", "type": "STRING" }, { "name": "co44", "type": "STRING" }, { "name": "co45", "type": "STRING" }, { "name": "co46", "type": "STRING" }, { "name": "co47", "type": "STRING" }, { "name": "co48", "type": "STRING" }, { "name": "co49", "type": "STRING" }, { "name": "co50", "type": "STRING" }, { "name": "co51", "type": "STRING" }, { "name": "co52", "type": "STRING" }, { "name": "co53", "type": "STRING" }, { "name": "co54", "type": "STRING" }, { "name": "co55", "type": "STRING" } ], "path": "/user/hive/warehouse/m3gcn_data_log.db/tab_map_race", "writeMode": "append", "fieldDelimiter": "," } } } ] } }

[yangsishu]

HdfsTextOutputFormat.writeSingleRecordInternal 在这个方法里设置断点，我看配置没什么问题，只要你的hdfs的配置信息没问题

[zhihui-ge]

没有进入这个方法HdfsTextOutputFormat.writeSingleRecordInternal，可能是什么原因啊