5555

Logged in as: dr.who 
Logs for container_1540265434662_0001_02_000001
ResourceManager
RM Home
NodeManager
Tools
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/opt/hadoop-2.7.7/tmp/nm-local-dir/usercache/root/filecache/10/__spark_libs__2642824955599675047.zip/slf4j-log4j12-1.7.16.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/hadoop-2.7.7/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
18/10/23 14:40:52 INFO util.SignalUtils: Registered signal handler for TERM
18/10/23 14:40:52 INFO util.SignalUtils: Registered signal handler for HUP
18/10/23 14:40:52 INFO util.SignalUtils: Registered signal handler for INT
18/10/23 14:40:53 INFO yarn.ApplicationMaster: Preparing Local resources
18/10/23 14:40:54 INFO yarn.ApplicationMaster: ApplicationAttemptId: appattempt_1540265434662_0001_000002
18/10/23 14:40:54 INFO spark.SecurityManager: Changing view acls to: root
18/10/23 14:40:54 INFO spark.SecurityManager: Changing modify acls to: root
18/10/23 14:40:54 INFO spark.SecurityManager: Changing view acls groups to: 
18/10/23 14:40:54 INFO spark.SecurityManager: Changing modify acls groups to: 
18/10/23 14:40:54 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(root); groups with view permissions: Set(); users  with modify permissions: Set(root); groups with modify permissions: Set()
18/10/23 14:40:54 INFO yarn.ApplicationMaster: Starting the user application in a separate Thread
18/10/23 14:40:54 INFO yarn.ApplicationMaster: Waiting for spark context initialization...
18/10/23 14:40:54 INFO spark.SparkContext: Running Spark version 2.2.2
18/10/23 14:40:54 INFO spark.SparkContext: Submitted application: TestSparkStreaming
18/10/23 14:40:54 INFO spark.SecurityManager: Changing view acls to: root
18/10/23 14:40:54 INFO spark.SecurityManager: Changing modify acls to: root
18/10/23 14:40:54 INFO spark.SecurityManager: Changing view acls groups to: 
18/10/23 14:40:54 INFO spark.SecurityManager: Changing modify acls groups to: 
18/10/23 14:40:54 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(root); groups with view permissions: Set(); users  with modify permissions: Set(root); groups with modify permissions: Set()
18/10/23 14:40:54 INFO util.Utils: Successfully started service 'sparkDriver' on port 42362.
18/10/23 14:40:54 INFO spark.SparkEnv: Registering MapOutputTracker
18/10/23 14:40:54 INFO spark.SparkEnv: Registering BlockManagerMaster
18/10/23 14:40:54 INFO storage.BlockManagerMasterEndpoint: Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information
18/10/23 14:40:54 INFO storage.BlockManagerMasterEndpoint: BlockManagerMasterEndpoint up
18/10/23 14:40:54 INFO storage.DiskBlockManager: Created local directory at /opt/hadoop-2.7.7/tmp/nm-local-dir/usercache/root/appcache/application_1540265434662_0001/blockmgr-e3823fc2-8774-4f65-8fe1-bbf0f99b6bce
18/10/23 14:40:54 INFO memory.MemoryStore: MemoryStore started with capacity 366.3 MB
18/10/23 14:40:54 INFO spark.SparkEnv: Registering OutputCommitCoordinator
18/10/23 14:40:54 INFO util.log: Logging initialized @3081ms
18/10/23 14:40:54 INFO ui.JettyUtils: Adding filter org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter to /jobs, /jobs/json, /jobs/job, /jobs/job/json, /stages, /stages/json, /stages/stage, /stages/stage/json, /stages/pool, /stages/pool/json, /storage, /storage/json, /storage/rdd, /storage/rdd/json, /environment, /environment/json, /executors, /executors/json, /executors/threadDump, /executors/threadDump/json, /static, /, /api, /jobs/job/kill, /stages/stage/kill.
18/10/23 14:40:54 INFO server.Server: jetty-9.3.z-SNAPSHOT
18/10/23 14:40:54 INFO server.Server: Started @3184ms
18/10/23 14:40:54 INFO server.AbstractConnector: Started ServerConnector@5a4f184{HTTP/1.1,[http/1.1]}{0.0.0.0:35555}
18/10/23 14:40:54 INFO util.Utils: Successfully started service 'SparkUI' on port 35555.
18/10/23 14:40:54 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@14ec2d38{/jobs,null,AVAILABLE,@Spark}
18/10/23 14:40:54 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@769c5495{/jobs/json,null,AVAILABLE,@Spark}
18/10/23 14:40:54 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@274efd87{/jobs/job,null,AVAILABLE,@Spark}
18/10/23 14:40:54 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@50bed3a3{/jobs/job/json,null,AVAILABLE,@Spark}
18/10/23 14:40:54 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@4540f26d{/stages,null,AVAILABLE,@Spark}
18/10/23 14:40:54 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@547826a8{/stages/json,null,AVAILABLE,@Spark}
18/10/23 14:40:54 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@73b7461c{/stages/stage,null,AVAILABLE,@Spark}
18/10/23 14:40:54 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@32ad8750{/stages/stage/json,null,AVAILABLE,@Spark}
18/10/23 14:40:54 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@6610f71e{/stages/pool,null,AVAILABLE,@Spark}
18/10/23 14:40:54 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@5e90dd1f{/stages/pool/json,null,AVAILABLE,@Spark}
18/10/23 14:40:54 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@1c8eec9{/storage,null,AVAILABLE,@Spark}
18/10/23 14:40:54 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@13114c2a{/storage/json,null,AVAILABLE,@Spark}
18/10/23 14:40:54 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@3fecfb18{/storage/rdd,null,AVAILABLE,@Spark}
18/10/23 14:40:54 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@6534d516{/storage/rdd/json,null,AVAILABLE,@Spark}
18/10/23 14:40:54 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@637073e1{/environment,null,AVAILABLE,@Spark}
18/10/23 14:40:54 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@31569ef8{/environment/json,null,AVAILABLE,@Spark}
18/10/23 14:40:54 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@940a333{/executors,null,AVAILABLE,@Spark}
18/10/23 14:40:54 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@359a2549{/executors/json,null,AVAILABLE,@Spark}
18/10/23 14:40:54 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@29c4e46a{/executors/threadDump,null,AVAILABLE,@Spark}
18/10/23 14:40:54 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@b8f64f9{/executors/threadDump/json,null,AVAILABLE,@Spark}
18/10/23 14:40:54 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@2c48a7d0{/static,null,AVAILABLE,@Spark}
18/10/23 14:40:54 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@4857f27{/,null,AVAILABLE,@Spark}
18/10/23 14:40:54 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@3f8b8bbf{/api,null,AVAILABLE,@Spark}
18/10/23 14:40:54 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@31f74028{/jobs/job/kill,null,AVAILABLE,@Spark}
18/10/23 14:40:54 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@7f46d801{/stages/stage/kill,null,AVAILABLE,@Spark}
18/10/23 14:40:54 INFO ui.SparkUI: Bound SparkUI to 0.0.0.0, and started at http://192.168.0.171:35555
18/10/23 14:40:55 INFO executor.Executor: Starting executor ID driver on host localhost
18/10/23 14:40:55 INFO util.Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 42480.
18/10/23 14:40:55 INFO netty.NettyBlockTransferService: Server created on 192.168.0.171:42480
18/10/23 14:40:55 INFO storage.BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy
18/10/23 14:40:55 INFO storage.BlockManagerMaster: Registering BlockManager BlockManagerId(driver, 192.168.0.171, 42480, None)
18/10/23 14:40:55 INFO storage.BlockManagerMasterEndpoint: Registering block manager 192.168.0.171:42480 with 366.3 MB RAM, BlockManagerId(driver, 192.168.0.171, 42480, None)
18/10/23 14:40:55 INFO storage.BlockManagerMaster: Registered BlockManager BlockManagerId(driver, 192.168.0.171, 42480, None)
18/10/23 14:40:55 INFO storage.BlockManager: Initialized BlockManager: BlockManagerId(driver, 192.168.0.171, 42480, None)
18/10/23 14:40:55 INFO ui.JettyUtils: Adding filter org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter to /metrics/json.
18/10/23 14:40:55 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@3f93fd3a{/metrics/json,null,AVAILABLE,@Spark}
18/10/23 14:40:55 WARN spark.SparkContext: Using an existing SparkContext; some configuration may not take effect.
18/10/23 14:40:55 WARN kafka010.KafkaUtils: overriding enable.auto.commit to false for executor
18/10/23 14:40:55 WARN kafka010.KafkaUtils: overriding auto.offset.reset to none for executor
18/10/23 14:40:55 WARN kafka010.KafkaUtils: overriding executor group.id to spark-executor-test
18/10/23 14:40:55 WARN kafka010.KafkaUtils: overriding receive.buffer.bytes to 65536 see KAFKA-3135
18/10/23 14:40:55 INFO kafka010.DirectKafkaInputDStream: Slide time = 1000 ms
18/10/23 14:40:55 INFO kafka010.DirectKafkaInputDStream: Storage level = Serialized 1x Replicated
18/10/23 14:40:55 INFO kafka010.DirectKafkaInputDStream: Checkpoint interval = null
18/10/23 14:40:55 INFO kafka010.DirectKafkaInputDStream: Remember interval = 1000 ms
18/10/23 14:40:55 INFO kafka010.DirectKafkaInputDStream: Initialized and validated org.apache.spark.streaming.kafka010.DirectKafkaInputDStream@1c75d995
18/10/23 14:40:55 INFO dstream.ForEachDStream: Slide time = 1000 ms
18/10/23 14:40:55 INFO dstream.ForEachDStream: Storage level = Serialized 1x Replicated
18/10/23 14:40:55 INFO dstream.ForEachDStream: Checkpoint interval = null
18/10/23 14:40:55 INFO dstream.ForEachDStream: Remember interval = 1000 ms
18/10/23 14:40:55 INFO dstream.ForEachDStream: Initialized and validated org.apache.spark.streaming.dstream.ForEachDStream@1db0e9b5
18/10/23 14:40:56 INFO consumer.ConsumerConfig: ConsumerConfig values: 
    metric.reporters = []
    metadata.max.age.ms = 300000
    partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor]
    reconnect.backoff.ms = 50
    sasl.kerberos.ticket.renew.window.factor = 0.8
    max.partition.fetch.bytes = 1048576
    bootstrap.servers = [192.168.0.170:9092]
    ssl.keystore.type = JKS
    enable.auto.commit = false
    sasl.mechanism = GSSAPI
    interceptor.classes = null
    exclude.internal.topics = true
    ssl.truststore.password = null
    client.id = 
    ssl.endpoint.identification.algorithm = null
    max.poll.records = 2147483647
    check.crcs = true
    request.timeout.ms = 40000
    heartbeat.interval.ms = 3000
    auto.commit.interval.ms = 5000
    receive.buffer.bytes = 65536
    ssl.truststore.type = JKS
    ssl.truststore.location = null
    ssl.keystore.password = null
    fetch.min.bytes = 1
    send.buffer.bytes = 131072
    value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer
    group.id = test
    retry.backoff.ms = 100
    sasl.kerberos.kinit.cmd = /usr/bin/kinit
    sasl.kerberos.service.name = null
    sasl.kerberos.ticket.renew.jitter = 0.05
    ssl.trustmanager.algorithm = PKIX
    ssl.key.password = null
    fetch.max.wait.ms = 500
    sasl.kerberos.min.time.before.relogin = 60000
    connections.max.idle.ms = 540000
    session.timeout.ms = 30000
    metrics.num.samples = 2
    key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer
    ssl.protocol = TLS
    ssl.provider = null
    ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
    ssl.keystore.location = null
    ssl.cipher.suites = null
    security.protocol = PLAINTEXT
    ssl.keymanager.algorithm = SunX509
    metrics.sample.window.ms = 30000
    auto.offset.reset = latest

18/10/23 14:40:56 INFO consumer.ConsumerConfig: ConsumerConfig values: 
    metric.reporters = []
    metadata.max.age.ms = 300000
    partition.assignment.strategy = [org.apache.kafka.clients.consumer.RangeAssignor]
    reconnect.backoff.ms = 50
    sasl.kerberos.ticket.renew.window.factor = 0.8
    max.partition.fetch.bytes = 1048576
    bootstrap.servers = [192.168.0.170:9092]
    ssl.keystore.type = JKS
    enable.auto.commit = false
    sasl.mechanism = GSSAPI
    interceptor.classes = null
    exclude.internal.topics = true
    ssl.truststore.password = null
    client.id = consumer-1
    ssl.endpoint.identification.algorithm = null
    max.poll.records = 2147483647
    check.crcs = true
    request.timeout.ms = 40000
    heartbeat.interval.ms = 3000
    auto.commit.interval.ms = 5000
    receive.buffer.bytes = 65536
    ssl.truststore.type = JKS
    ssl.truststore.location = null
    ssl.keystore.password = null
    fetch.min.bytes = 1
    send.buffer.bytes = 131072
    value.deserializer = class org.apache.kafka.common.serialization.StringDeserializer
    group.id = test
    retry.backoff.ms = 100
    sasl.kerberos.kinit.cmd = /usr/bin/kinit
    sasl.kerberos.service.name = null
    sasl.kerberos.ticket.renew.jitter = 0.05
    ssl.trustmanager.algorithm = PKIX
    ssl.key.password = null
    fetch.max.wait.ms = 500
    sasl.kerberos.min.time.before.relogin = 60000
    connections.max.idle.ms = 540000
    session.timeout.ms = 30000
    metrics.num.samples = 2
    key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer
    ssl.protocol = TLS
    ssl.provider = null
    ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
    ssl.keystore.location = null
    ssl.cipher.suites = null
    security.protocol = PLAINTEXT
    ssl.keymanager.algorithm = SunX509
    metrics.sample.window.ms = 30000
    auto.offset.reset = latest

18/10/23 14:40:56 INFO utils.AppInfoParser: Kafka version : 0.10.0.1
18/10/23 14:40:56 INFO utils.AppInfoParser: Kafka commitId : a7a17cdec9eaa6c5
18/10/23 14:40:56 INFO internals.AbstractCoordinator: Discovered coordinator 192.168.0.172:9092 (id: 2147483475 rack: null) for group test.
18/10/23 14:40:56 INFO internals.ConsumerCoordinator: Revoking previously assigned partitions [] for group test
18/10/23 14:40:56 INFO internals.AbstractCoordinator: (Re-)joining group test
18/10/23 14:40:56 INFO internals.AbstractCoordinator: Successfully joined group test with generation 3
18/10/23 14:40:56 INFO internals.ConsumerCoordinator: Setting newly assigned partitions [test-1, test-0] for group test
18/10/23 14:40:56 INFO util.RecurringTimer: Started timer for JobGenerator at time 1540276856000
18/10/23 14:40:56 INFO scheduler.JobGenerator: Started JobGenerator at 1540276856000 ms
18/10/23 14:40:56 INFO scheduler.JobScheduler: Started JobScheduler
18/10/23 14:40:56 INFO ui.JettyUtils: Adding filter org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter to /streaming.
18/10/23 14:40:56 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@8e1d9c1{/streaming,null,AVAILABLE,@Spark}
18/10/23 14:40:56 INFO ui.JettyUtils: Adding filter org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter to /streaming/json.
18/10/23 14:40:56 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@696bfb43{/streaming/json,null,AVAILABLE,@Spark}
18/10/23 14:40:56 INFO ui.JettyUtils: Adding filter org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter to /streaming/batch.
18/10/23 14:40:56 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@5ccd562a{/streaming/batch,null,AVAILABLE,@Spark}
18/10/23 14:40:56 INFO ui.JettyUtils: Adding filter org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter to /streaming/batch/json.
18/10/23 14:40:56 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@2af3b063{/streaming/batch/json,null,AVAILABLE,@Spark}
18/10/23 14:40:56 INFO ui.JettyUtils: Adding filter org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter to /static/streaming.
18/10/23 14:40:56 INFO handler.ContextHandler: Started o.s.j.s.ServletContextHandler@4c9582f8{/static/streaming,null,AVAILABLE,@Spark}
18/10/23 14:40:56 INFO streaming.StreamingContext: StreamingContext started
18/10/23 14:40:56 INFO scheduler.JobScheduler: Added jobs for time 1540276856000 ms
18/10/23 14:40:56 INFO scheduler.JobScheduler: Starting job streaming job 1540276856000 ms.0 from job set of time 1540276856000 ms
18/10/23 14:40:56 INFO scheduler.JobScheduler: Finished job streaming job 1540276856000 ms.0 from job set of time 1540276856000 ms
18/10/23 14:40:56 INFO scheduler.JobScheduler: Total delay: 0.882 s for time 1540276856000 ms (execution: 0.002 s)
18/10/23 14:40:56 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:40:56 INFO scheduler.InputInfoTracker: remove old batch metadata: 
18/10/23 14:40:57 INFO scheduler.JobScheduler: Added jobs for time 1540276857000 ms
18/10/23 14:40:57 INFO scheduler.JobScheduler: Starting job streaming job 1540276857000 ms.0 from job set of time 1540276857000 ms
18/10/23 14:40:57 INFO scheduler.JobScheduler: Finished job streaming job 1540276857000 ms.0 from job set of time 1540276857000 ms
18/10/23 14:40:57 INFO scheduler.JobScheduler: Total delay: 0.005 s for time 1540276857000 ms (execution: 0.000 s)
18/10/23 14:40:57 INFO kafka010.KafkaRDD: Removing RDD 0 from persistence list
18/10/23 14:40:57 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:40:57 INFO scheduler.InputInfoTracker: remove old batch metadata: 
18/10/23 14:40:57 INFO storage.BlockManager: Removing RDD 0
18/10/23 14:40:58 INFO scheduler.JobScheduler: Added jobs for time 1540276858000 ms
18/10/23 14:40:58 INFO scheduler.JobScheduler: Starting job streaming job 1540276858000 ms.0 from job set of time 1540276858000 ms
18/10/23 14:40:58 INFO scheduler.JobScheduler: Finished job streaming job 1540276858000 ms.0 from job set of time 1540276858000 ms
18/10/23 14:40:58 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276858000 ms (execution: 0.000 s)
18/10/23 14:40:58 INFO kafka010.KafkaRDD: Removing RDD 1 from persistence list
18/10/23 14:40:58 INFO storage.BlockManager: Removing RDD 1
18/10/23 14:40:58 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:40:58 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276856000 ms
18/10/23 14:40:59 INFO scheduler.JobScheduler: Added jobs for time 1540276859000 ms
18/10/23 14:40:59 INFO scheduler.JobScheduler: Starting job streaming job 1540276859000 ms.0 from job set of time 1540276859000 ms
18/10/23 14:40:59 INFO scheduler.JobScheduler: Finished job streaming job 1540276859000 ms.0 from job set of time 1540276859000 ms
18/10/23 14:40:59 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276859000 ms (execution: 0.000 s)
18/10/23 14:40:59 INFO kafka010.KafkaRDD: Removing RDD 2 from persistence list
18/10/23 14:40:59 INFO storage.BlockManager: Removing RDD 2
18/10/23 14:40:59 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:40:59 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276857000 ms
18/10/23 14:41:00 INFO scheduler.JobScheduler: Added jobs for time 1540276860000 ms
18/10/23 14:41:00 INFO scheduler.JobScheduler: Starting job streaming job 1540276860000 ms.0 from job set of time 1540276860000 ms
18/10/23 14:41:00 INFO scheduler.JobScheduler: Finished job streaming job 1540276860000 ms.0 from job set of time 1540276860000 ms
18/10/23 14:41:00 INFO kafka010.KafkaRDD: Removing RDD 3 from persistence list
18/10/23 14:41:00 INFO scheduler.JobScheduler: Total delay: 0.009 s for time 1540276860000 ms (execution: 0.000 s)
18/10/23 14:41:00 INFO storage.BlockManager: Removing RDD 3
18/10/23 14:41:00 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:00 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276858000 ms
18/10/23 14:41:01 INFO scheduler.JobScheduler: Added jobs for time 1540276861000 ms
18/10/23 14:41:01 INFO scheduler.JobScheduler: Starting job streaming job 1540276861000 ms.0 from job set of time 1540276861000 ms
18/10/23 14:41:01 INFO scheduler.JobScheduler: Finished job streaming job 1540276861000 ms.0 from job set of time 1540276861000 ms
18/10/23 14:41:01 INFO scheduler.JobScheduler: Total delay: 0.006 s for time 1540276861000 ms (execution: 0.000 s)
18/10/23 14:41:01 INFO kafka010.KafkaRDD: Removing RDD 4 from persistence list
18/10/23 14:41:01 INFO storage.BlockManager: Removing RDD 4
18/10/23 14:41:01 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:01 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276859000 ms
18/10/23 14:41:02 INFO scheduler.JobScheduler: Added jobs for time 1540276862000 ms
18/10/23 14:41:02 INFO scheduler.JobScheduler: Starting job streaming job 1540276862000 ms.0 from job set of time 1540276862000 ms
18/10/23 14:41:02 INFO scheduler.JobScheduler: Finished job streaming job 1540276862000 ms.0 from job set of time 1540276862000 ms
18/10/23 14:41:02 INFO scheduler.JobScheduler: Total delay: 0.006 s for time 1540276862000 ms (execution: 0.000 s)
18/10/23 14:41:02 INFO kafka010.KafkaRDD: Removing RDD 5 from persistence list
18/10/23 14:41:02 INFO storage.BlockManager: Removing RDD 5
18/10/23 14:41:02 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:02 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276860000 ms
18/10/23 14:41:03 INFO scheduler.JobScheduler: Added jobs for time 1540276863000 ms
18/10/23 14:41:03 INFO scheduler.JobScheduler: Starting job streaming job 1540276863000 ms.0 from job set of time 1540276863000 ms
18/10/23 14:41:03 INFO scheduler.JobScheduler: Finished job streaming job 1540276863000 ms.0 from job set of time 1540276863000 ms
18/10/23 14:41:03 INFO scheduler.JobScheduler: Total delay: 0.005 s for time 1540276863000 ms (execution: 0.000 s)
18/10/23 14:41:03 INFO kafka010.KafkaRDD: Removing RDD 6 from persistence list
18/10/23 14:41:03 INFO storage.BlockManager: Removing RDD 6
18/10/23 14:41:03 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:03 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276861000 ms
18/10/23 14:41:04 INFO scheduler.JobScheduler: Added jobs for time 1540276864000 ms
18/10/23 14:41:04 INFO scheduler.JobScheduler: Starting job streaming job 1540276864000 ms.0 from job set of time 1540276864000 ms
18/10/23 14:41:04 INFO scheduler.JobScheduler: Finished job streaming job 1540276864000 ms.0 from job set of time 1540276864000 ms
18/10/23 14:41:04 INFO kafka010.KafkaRDD: Removing RDD 7 from persistence list
18/10/23 14:41:04 INFO scheduler.JobScheduler: Total delay: 0.005 s for time 1540276864000 ms (execution: 0.000 s)
18/10/23 14:41:04 INFO storage.BlockManager: Removing RDD 7
18/10/23 14:41:04 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:04 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276862000 ms
18/10/23 14:41:05 INFO scheduler.JobScheduler: Added jobs for time 1540276865000 ms
18/10/23 14:41:05 INFO scheduler.JobScheduler: Starting job streaming job 1540276865000 ms.0 from job set of time 1540276865000 ms
18/10/23 14:41:05 INFO scheduler.JobScheduler: Finished job streaming job 1540276865000 ms.0 from job set of time 1540276865000 ms
18/10/23 14:41:05 INFO scheduler.JobScheduler: Total delay: 0.006 s for time 1540276865000 ms (execution: 0.000 s)
18/10/23 14:41:05 INFO kafka010.KafkaRDD: Removing RDD 8 from persistence list
18/10/23 14:41:05 INFO storage.BlockManager: Removing RDD 8
18/10/23 14:41:05 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:05 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276863000 ms
18/10/23 14:41:06 INFO scheduler.JobScheduler: Added jobs for time 1540276866000 ms
18/10/23 14:41:06 INFO scheduler.JobScheduler: Starting job streaming job 1540276866000 ms.0 from job set of time 1540276866000 ms
18/10/23 14:41:06 INFO scheduler.JobScheduler: Finished job streaming job 1540276866000 ms.0 from job set of time 1540276866000 ms
18/10/23 14:41:06 INFO scheduler.JobScheduler: Total delay: 0.005 s for time 1540276866000 ms (execution: 0.000 s)
18/10/23 14:41:06 INFO kafka010.KafkaRDD: Removing RDD 9 from persistence list
18/10/23 14:41:06 INFO storage.BlockManager: Removing RDD 9
18/10/23 14:41:06 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:06 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276864000 ms
18/10/23 14:41:07 INFO scheduler.JobScheduler: Added jobs for time 1540276867000 ms
18/10/23 14:41:07 INFO scheduler.JobScheduler: Starting job streaming job 1540276867000 ms.0 from job set of time 1540276867000 ms
18/10/23 14:41:07 INFO scheduler.JobScheduler: Finished job streaming job 1540276867000 ms.0 from job set of time 1540276867000 ms
18/10/23 14:41:07 INFO kafka010.KafkaRDD: Removing RDD 10 from persistence list
18/10/23 14:41:07 INFO scheduler.JobScheduler: Total delay: 0.005 s for time 1540276867000 ms (execution: 0.001 s)
18/10/23 14:41:07 INFO storage.BlockManager: Removing RDD 10
18/10/23 14:41:07 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:07 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276865000 ms
18/10/23 14:41:08 INFO scheduler.JobScheduler: Added jobs for time 1540276868000 ms
18/10/23 14:41:08 INFO scheduler.JobScheduler: Starting job streaming job 1540276868000 ms.0 from job set of time 1540276868000 ms
18/10/23 14:41:08 INFO scheduler.JobScheduler: Finished job streaming job 1540276868000 ms.0 from job set of time 1540276868000 ms
18/10/23 14:41:08 INFO scheduler.JobScheduler: Total delay: 0.005 s for time 1540276868000 ms (execution: 0.000 s)
18/10/23 14:41:08 INFO kafka010.KafkaRDD: Removing RDD 11 from persistence list
18/10/23 14:41:08 INFO storage.BlockManager: Removing RDD 11
18/10/23 14:41:08 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:08 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276866000 ms
18/10/23 14:41:09 INFO scheduler.JobScheduler: Added jobs for time 1540276869000 ms
18/10/23 14:41:09 INFO scheduler.JobScheduler: Starting job streaming job 1540276869000 ms.0 from job set of time 1540276869000 ms
18/10/23 14:41:09 INFO scheduler.JobScheduler: Finished job streaming job 1540276869000 ms.0 from job set of time 1540276869000 ms
18/10/23 14:41:09 INFO kafka010.KafkaRDD: Removing RDD 12 from persistence list
18/10/23 14:41:09 INFO scheduler.JobScheduler: Total delay: 0.005 s for time 1540276869000 ms (execution: 0.000 s)
18/10/23 14:41:09 INFO storage.BlockManager: Removing RDD 12
18/10/23 14:41:09 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:09 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276867000 ms
18/10/23 14:41:10 INFO scheduler.JobScheduler: Added jobs for time 1540276870000 ms
18/10/23 14:41:10 INFO scheduler.JobScheduler: Starting job streaming job 1540276870000 ms.0 from job set of time 1540276870000 ms
18/10/23 14:41:10 INFO scheduler.JobScheduler: Finished job streaming job 1540276870000 ms.0 from job set of time 1540276870000 ms
18/10/23 14:41:10 INFO kafka010.KafkaRDD: Removing RDD 13 from persistence list
18/10/23 14:41:10 INFO scheduler.JobScheduler: Total delay: 0.005 s for time 1540276870000 ms (execution: 0.000 s)
18/10/23 14:41:10 INFO storage.BlockManager: Removing RDD 13
18/10/23 14:41:10 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:10 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276868000 ms
18/10/23 14:41:11 INFO scheduler.JobScheduler: Added jobs for time 1540276871000 ms
18/10/23 14:41:11 INFO scheduler.JobScheduler: Starting job streaming job 1540276871000 ms.0 from job set of time 1540276871000 ms
18/10/23 14:41:11 INFO scheduler.JobScheduler: Finished job streaming job 1540276871000 ms.0 from job set of time 1540276871000 ms
18/10/23 14:41:11 INFO scheduler.JobScheduler: Total delay: 0.005 s for time 1540276871000 ms (execution: 0.000 s)
18/10/23 14:41:11 INFO kafka010.KafkaRDD: Removing RDD 14 from persistence list
18/10/23 14:41:11 INFO storage.BlockManager: Removing RDD 14
18/10/23 14:41:11 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:11 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276869000 ms
18/10/23 14:41:12 INFO scheduler.JobScheduler: Added jobs for time 1540276872000 ms
18/10/23 14:41:12 INFO scheduler.JobScheduler: Starting job streaming job 1540276872000 ms.0 from job set of time 1540276872000 ms
18/10/23 14:41:12 INFO scheduler.JobScheduler: Finished job streaming job 1540276872000 ms.0 from job set of time 1540276872000 ms
18/10/23 14:41:12 INFO kafka010.KafkaRDD: Removing RDD 15 from persistence list
18/10/23 14:41:12 INFO storage.BlockManager: Removing RDD 15
18/10/23 14:41:12 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:12 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276870000 ms
18/10/23 14:41:12 INFO scheduler.JobScheduler: Total delay: 0.005 s for time 1540276872000 ms (execution: 0.000 s)
18/10/23 14:41:13 INFO scheduler.JobScheduler: Added jobs for time 1540276873000 ms
18/10/23 14:41:13 INFO scheduler.JobScheduler: Starting job streaming job 1540276873000 ms.0 from job set of time 1540276873000 ms
18/10/23 14:41:13 INFO scheduler.JobScheduler: Finished job streaming job 1540276873000 ms.0 from job set of time 1540276873000 ms
18/10/23 14:41:13 INFO kafka010.KafkaRDD: Removing RDD 16 from persistence list
18/10/23 14:41:13 INFO scheduler.JobScheduler: Total delay: 0.005 s for time 1540276873000 ms (execution: 0.001 s)
18/10/23 14:41:13 INFO storage.BlockManager: Removing RDD 16
18/10/23 14:41:13 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:13 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276871000 ms
18/10/23 14:41:14 INFO scheduler.JobScheduler: Added jobs for time 1540276874000 ms
18/10/23 14:41:14 INFO scheduler.JobScheduler: Starting job streaming job 1540276874000 ms.0 from job set of time 1540276874000 ms
18/10/23 14:41:14 INFO scheduler.JobScheduler: Finished job streaming job 1540276874000 ms.0 from job set of time 1540276874000 ms
18/10/23 14:41:14 INFO kafka010.KafkaRDD: Removing RDD 17 from persistence list
18/10/23 14:41:14 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276874000 ms (execution: 0.000 s)
18/10/23 14:41:14 INFO storage.BlockManager: Removing RDD 17
18/10/23 14:41:14 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:14 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276872000 ms
18/10/23 14:41:15 INFO scheduler.JobScheduler: Added jobs for time 1540276875000 ms
18/10/23 14:41:15 INFO scheduler.JobScheduler: Starting job streaming job 1540276875000 ms.0 from job set of time 1540276875000 ms
18/10/23 14:41:15 INFO scheduler.JobScheduler: Finished job streaming job 1540276875000 ms.0 from job set of time 1540276875000 ms
18/10/23 14:41:15 INFO kafka010.KafkaRDD: Removing RDD 18 from persistence list
18/10/23 14:41:15 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276875000 ms (execution: 0.000 s)
18/10/23 14:41:15 INFO storage.BlockManager: Removing RDD 18
18/10/23 14:41:15 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:15 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276873000 ms
18/10/23 14:41:16 INFO scheduler.JobScheduler: Added jobs for time 1540276876000 ms
18/10/23 14:41:16 INFO scheduler.JobScheduler: Starting job streaming job 1540276876000 ms.0 from job set of time 1540276876000 ms
18/10/23 14:41:16 INFO scheduler.JobScheduler: Finished job streaming job 1540276876000 ms.0 from job set of time 1540276876000 ms
18/10/23 14:41:16 INFO kafka010.KafkaRDD: Removing RDD 19 from persistence list
18/10/23 14:41:16 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276876000 ms (execution: 0.000 s)
18/10/23 14:41:16 INFO storage.BlockManager: Removing RDD 19
18/10/23 14:41:16 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:16 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276874000 ms
18/10/23 14:41:17 INFO scheduler.JobScheduler: Added jobs for time 1540276877000 ms
18/10/23 14:41:17 INFO scheduler.JobScheduler: Starting job streaming job 1540276877000 ms.0 from job set of time 1540276877000 ms
18/10/23 14:41:17 INFO scheduler.JobScheduler: Finished job streaming job 1540276877000 ms.0 from job set of time 1540276877000 ms
18/10/23 14:41:17 INFO kafka010.KafkaRDD: Removing RDD 20 from persistence list
18/10/23 14:41:17 INFO scheduler.JobScheduler: Total delay: 0.005 s for time 1540276877000 ms (execution: 0.001 s)
18/10/23 14:41:17 INFO storage.BlockManager: Removing RDD 20
18/10/23 14:41:17 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:17 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276875000 ms
18/10/23 14:41:18 INFO scheduler.JobScheduler: Added jobs for time 1540276878000 ms
18/10/23 14:41:18 INFO scheduler.JobScheduler: Starting job streaming job 1540276878000 ms.0 from job set of time 1540276878000 ms
18/10/23 14:41:18 INFO scheduler.JobScheduler: Finished job streaming job 1540276878000 ms.0 from job set of time 1540276878000 ms
18/10/23 14:41:18 INFO kafka010.KafkaRDD: Removing RDD 21 from persistence list
18/10/23 14:41:18 INFO scheduler.JobScheduler: Total delay: 0.005 s for time 1540276878000 ms (execution: 0.001 s)
18/10/23 14:41:18 INFO storage.BlockManager: Removing RDD 21
18/10/23 14:41:18 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:18 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276876000 ms
18/10/23 14:41:19 INFO scheduler.JobScheduler: Added jobs for time 1540276879000 ms
18/10/23 14:41:19 INFO scheduler.JobScheduler: Starting job streaming job 1540276879000 ms.0 from job set of time 1540276879000 ms
18/10/23 14:41:19 INFO scheduler.JobScheduler: Finished job streaming job 1540276879000 ms.0 from job set of time 1540276879000 ms
18/10/23 14:41:19 INFO kafka010.KafkaRDD: Removing RDD 22 from persistence list
18/10/23 14:41:19 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276879000 ms (execution: 0.000 s)
18/10/23 14:41:19 INFO storage.BlockManager: Removing RDD 22
18/10/23 14:41:19 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:19 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276877000 ms
18/10/23 14:41:20 INFO scheduler.JobScheduler: Added jobs for time 1540276880000 ms
18/10/23 14:41:20 INFO scheduler.JobScheduler: Starting job streaming job 1540276880000 ms.0 from job set of time 1540276880000 ms
18/10/23 14:41:20 INFO scheduler.JobScheduler: Finished job streaming job 1540276880000 ms.0 from job set of time 1540276880000 ms
18/10/23 14:41:20 INFO kafka010.KafkaRDD: Removing RDD 23 from persistence list
18/10/23 14:41:20 INFO scheduler.JobScheduler: Total delay: 0.005 s for time 1540276880000 ms (execution: 0.000 s)
18/10/23 14:41:20 INFO storage.BlockManager: Removing RDD 23
18/10/23 14:41:20 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:20 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276878000 ms
18/10/23 14:41:21 INFO scheduler.JobScheduler: Added jobs for time 1540276881000 ms
18/10/23 14:41:21 INFO scheduler.JobScheduler: Starting job streaming job 1540276881000 ms.0 from job set of time 1540276881000 ms
18/10/23 14:41:21 INFO scheduler.JobScheduler: Finished job streaming job 1540276881000 ms.0 from job set of time 1540276881000 ms
18/10/23 14:41:21 INFO kafka010.KafkaRDD: Removing RDD 24 from persistence list
18/10/23 14:41:21 INFO scheduler.JobScheduler: Total delay: 0.005 s for time 1540276881000 ms (execution: 0.000 s)
18/10/23 14:41:21 INFO storage.BlockManager: Removing RDD 24
18/10/23 14:41:21 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:21 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276879000 ms
18/10/23 14:41:22 INFO scheduler.JobScheduler: Added jobs for time 1540276882000 ms
18/10/23 14:41:22 INFO scheduler.JobScheduler: Starting job streaming job 1540276882000 ms.0 from job set of time 1540276882000 ms
18/10/23 14:41:22 INFO scheduler.JobScheduler: Finished job streaming job 1540276882000 ms.0 from job set of time 1540276882000 ms
18/10/23 14:41:22 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276882000 ms (execution: 0.000 s)
18/10/23 14:41:22 INFO kafka010.KafkaRDD: Removing RDD 25 from persistence list
18/10/23 14:41:22 INFO storage.BlockManager: Removing RDD 25
18/10/23 14:41:22 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:22 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276880000 ms
18/10/23 14:41:23 INFO scheduler.JobScheduler: Added jobs for time 1540276883000 ms
18/10/23 14:41:23 INFO scheduler.JobScheduler: Starting job streaming job 1540276883000 ms.0 from job set of time 1540276883000 ms
18/10/23 14:41:23 INFO scheduler.JobScheduler: Finished job streaming job 1540276883000 ms.0 from job set of time 1540276883000 ms
18/10/23 14:41:23 INFO kafka010.KafkaRDD: Removing RDD 26 from persistence list
18/10/23 14:41:23 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276883000 ms (execution: 0.000 s)
18/10/23 14:41:23 INFO storage.BlockManager: Removing RDD 26
18/10/23 14:41:23 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:23 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276881000 ms
18/10/23 14:41:24 INFO scheduler.JobScheduler: Added jobs for time 1540276884000 ms
18/10/23 14:41:24 INFO scheduler.JobScheduler: Starting job streaming job 1540276884000 ms.0 from job set of time 1540276884000 ms
18/10/23 14:41:24 INFO scheduler.JobScheduler: Finished job streaming job 1540276884000 ms.0 from job set of time 1540276884000 ms
18/10/23 14:41:24 INFO scheduler.JobScheduler: Total delay: 0.005 s for time 1540276884000 ms (execution: 0.001 s)
18/10/23 14:41:24 INFO kafka010.KafkaRDD: Removing RDD 27 from persistence list
18/10/23 14:41:24 INFO storage.BlockManager: Removing RDD 27
18/10/23 14:41:24 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:24 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276882000 ms
18/10/23 14:41:25 INFO scheduler.JobScheduler: Added jobs for time 1540276885000 ms
18/10/23 14:41:25 INFO scheduler.JobScheduler: Starting job streaming job 1540276885000 ms.0 from job set of time 1540276885000 ms
18/10/23 14:41:25 INFO scheduler.JobScheduler: Finished job streaming job 1540276885000 ms.0 from job set of time 1540276885000 ms
18/10/23 14:41:25 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276885000 ms (execution: 0.000 s)
18/10/23 14:41:25 INFO kafka010.KafkaRDD: Removing RDD 28 from persistence list
18/10/23 14:41:25 INFO storage.BlockManager: Removing RDD 28
18/10/23 14:41:25 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:25 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276883000 ms
18/10/23 14:41:26 INFO scheduler.JobScheduler: Added jobs for time 1540276886000 ms
18/10/23 14:41:26 INFO scheduler.JobScheduler: Starting job streaming job 1540276886000 ms.0 from job set of time 1540276886000 ms
18/10/23 14:41:26 INFO scheduler.JobScheduler: Finished job streaming job 1540276886000 ms.0 from job set of time 1540276886000 ms
18/10/23 14:41:26 INFO kafka010.KafkaRDD: Removing RDD 29 from persistence list
18/10/23 14:41:26 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276886000 ms (execution: 0.000 s)
18/10/23 14:41:26 INFO storage.BlockManager: Removing RDD 29
18/10/23 14:41:26 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:26 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276884000 ms
18/10/23 14:41:27 INFO scheduler.JobScheduler: Added jobs for time 1540276887000 ms
18/10/23 14:41:27 INFO scheduler.JobScheduler: Starting job streaming job 1540276887000 ms.0 from job set of time 1540276887000 ms
18/10/23 14:41:27 INFO scheduler.JobScheduler: Finished job streaming job 1540276887000 ms.0 from job set of time 1540276887000 ms
18/10/23 14:41:27 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276887000 ms (execution: 0.000 s)
18/10/23 14:41:27 INFO kafka010.KafkaRDD: Removing RDD 30 from persistence list
18/10/23 14:41:27 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:27 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276885000 ms
18/10/23 14:41:27 INFO storage.BlockManager: Removing RDD 30
18/10/23 14:41:28 INFO scheduler.JobScheduler: Added jobs for time 1540276888000 ms
18/10/23 14:41:28 INFO scheduler.JobScheduler: Starting job streaming job 1540276888000 ms.0 from job set of time 1540276888000 ms
18/10/23 14:41:28 INFO scheduler.JobScheduler: Finished job streaming job 1540276888000 ms.0 from job set of time 1540276888000 ms
18/10/23 14:41:28 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276888000 ms (execution: 0.000 s)
18/10/23 14:41:28 INFO kafka010.KafkaRDD: Removing RDD 31 from persistence list
18/10/23 14:41:28 INFO storage.BlockManager: Removing RDD 31
18/10/23 14:41:28 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:28 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276886000 ms
18/10/23 14:41:29 INFO scheduler.JobScheduler: Added jobs for time 1540276889000 ms
18/10/23 14:41:29 INFO scheduler.JobScheduler: Starting job streaming job 1540276889000 ms.0 from job set of time 1540276889000 ms
18/10/23 14:41:29 INFO scheduler.JobScheduler: Finished job streaming job 1540276889000 ms.0 from job set of time 1540276889000 ms
18/10/23 14:41:29 INFO scheduler.JobScheduler: Total delay: 0.005 s for time 1540276889000 ms (execution: 0.001 s)
18/10/23 14:41:29 INFO kafka010.KafkaRDD: Removing RDD 32 from persistence list
18/10/23 14:41:29 INFO storage.BlockManager: Removing RDD 32
18/10/23 14:41:29 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:29 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276887000 ms
18/10/23 14:41:30 INFO scheduler.JobScheduler: Added jobs for time 1540276890000 ms
18/10/23 14:41:30 INFO scheduler.JobScheduler: Starting job streaming job 1540276890000 ms.0 from job set of time 1540276890000 ms
18/10/23 14:41:30 INFO scheduler.JobScheduler: Finished job streaming job 1540276890000 ms.0 from job set of time 1540276890000 ms
18/10/23 14:41:30 INFO kafka010.KafkaRDD: Removing RDD 33 from persistence list
18/10/23 14:41:30 INFO scheduler.JobScheduler: Total delay: 0.005 s for time 1540276890000 ms (execution: 0.000 s)
18/10/23 14:41:30 INFO storage.BlockManager: Removing RDD 33
18/10/23 14:41:30 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:30 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276888000 ms
18/10/23 14:41:31 INFO scheduler.JobScheduler: Added jobs for time 1540276891000 ms
18/10/23 14:41:31 INFO scheduler.JobScheduler: Starting job streaming job 1540276891000 ms.0 from job set of time 1540276891000 ms
18/10/23 14:41:31 INFO scheduler.JobScheduler: Finished job streaming job 1540276891000 ms.0 from job set of time 1540276891000 ms
18/10/23 14:41:31 INFO kafka010.KafkaRDD: Removing RDD 34 from persistence list
18/10/23 14:41:31 INFO scheduler.JobScheduler: Total delay: 0.005 s for time 1540276891000 ms (execution: 0.000 s)
18/10/23 14:41:31 INFO storage.BlockManager: Removing RDD 34
18/10/23 14:41:31 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:31 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276889000 ms
18/10/23 14:41:32 INFO scheduler.JobScheduler: Added jobs for time 1540276892000 ms
18/10/23 14:41:32 INFO scheduler.JobScheduler: Starting job streaming job 1540276892000 ms.0 from job set of time 1540276892000 ms
18/10/23 14:41:32 INFO scheduler.JobScheduler: Finished job streaming job 1540276892000 ms.0 from job set of time 1540276892000 ms
18/10/23 14:41:32 INFO kafka010.KafkaRDD: Removing RDD 35 from persistence list
18/10/23 14:41:32 INFO scheduler.JobScheduler: Total delay: 0.005 s for time 1540276892000 ms (execution: 0.000 s)
18/10/23 14:41:32 INFO storage.BlockManager: Removing RDD 35
18/10/23 14:41:32 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:32 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276890000 ms
18/10/23 14:41:33 INFO scheduler.JobScheduler: Added jobs for time 1540276893000 ms
18/10/23 14:41:33 INFO scheduler.JobScheduler: Starting job streaming job 1540276893000 ms.0 from job set of time 1540276893000 ms
18/10/23 14:41:33 INFO scheduler.JobScheduler: Finished job streaming job 1540276893000 ms.0 from job set of time 1540276893000 ms
18/10/23 14:41:33 INFO kafka010.KafkaRDD: Removing RDD 36 from persistence list
18/10/23 14:41:33 INFO scheduler.JobScheduler: Total delay: 0.005 s for time 1540276893000 ms (execution: 0.000 s)
18/10/23 14:41:33 INFO storage.BlockManager: Removing RDD 36
18/10/23 14:41:33 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:33 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276891000 ms
18/10/23 14:41:34 INFO scheduler.JobScheduler: Added jobs for time 1540276894000 ms
18/10/23 14:41:34 INFO scheduler.JobScheduler: Starting job streaming job 1540276894000 ms.0 from job set of time 1540276894000 ms
18/10/23 14:41:34 INFO scheduler.JobScheduler: Finished job streaming job 1540276894000 ms.0 from job set of time 1540276894000 ms
18/10/23 14:41:34 INFO kafka010.KafkaRDD: Removing RDD 37 from persistence list
18/10/23 14:41:34 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276894000 ms (execution: 0.000 s)
18/10/23 14:41:34 INFO storage.BlockManager: Removing RDD 37
18/10/23 14:41:34 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:34 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276892000 ms
18/10/23 14:41:35 INFO scheduler.JobScheduler: Added jobs for time 1540276895000 ms
18/10/23 14:41:35 INFO scheduler.JobScheduler: Starting job streaming job 1540276895000 ms.0 from job set of time 1540276895000 ms
18/10/23 14:41:35 INFO scheduler.JobScheduler: Finished job streaming job 1540276895000 ms.0 from job set of time 1540276895000 ms
18/10/23 14:41:35 INFO kafka010.KafkaRDD: Removing RDD 38 from persistence list
18/10/23 14:41:35 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276895000 ms (execution: 0.000 s)
18/10/23 14:41:35 INFO storage.BlockManager: Removing RDD 38
18/10/23 14:41:35 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:35 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276893000 ms
18/10/23 14:41:36 INFO scheduler.JobScheduler: Added jobs for time 1540276896000 ms
18/10/23 14:41:36 INFO scheduler.JobScheduler: Starting job streaming job 1540276896000 ms.0 from job set of time 1540276896000 ms
18/10/23 14:41:36 INFO scheduler.JobScheduler: Finished job streaming job 1540276896000 ms.0 from job set of time 1540276896000 ms
18/10/23 14:41:36 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276896000 ms (execution: 0.000 s)
18/10/23 14:41:36 INFO kafka010.KafkaRDD: Removing RDD 39 from persistence list
18/10/23 14:41:36 INFO storage.BlockManager: Removing RDD 39
18/10/23 14:41:36 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:36 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276894000 ms
18/10/23 14:41:37 INFO scheduler.JobScheduler: Added jobs for time 1540276897000 ms
18/10/23 14:41:37 INFO scheduler.JobScheduler: Starting job streaming job 1540276897000 ms.0 from job set of time 1540276897000 ms
18/10/23 14:41:37 INFO scheduler.JobScheduler: Finished job streaming job 1540276897000 ms.0 from job set of time 1540276897000 ms
18/10/23 14:41:37 INFO kafka010.KafkaRDD: Removing RDD 40 from persistence list
18/10/23 14:41:37 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276897000 ms (execution: 0.000 s)
18/10/23 14:41:37 INFO storage.BlockManager: Removing RDD 40
18/10/23 14:41:37 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:37 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276895000 ms
18/10/23 14:41:38 INFO scheduler.JobScheduler: Added jobs for time 1540276898000 ms
18/10/23 14:41:38 INFO scheduler.JobScheduler: Starting job streaming job 1540276898000 ms.0 from job set of time 1540276898000 ms
18/10/23 14:41:38 INFO scheduler.JobScheduler: Finished job streaming job 1540276898000 ms.0 from job set of time 1540276898000 ms
18/10/23 14:41:38 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276898000 ms (execution: 0.000 s)
18/10/23 14:41:38 INFO kafka010.KafkaRDD: Removing RDD 41 from persistence list
18/10/23 14:41:38 INFO storage.BlockManager: Removing RDD 41
18/10/23 14:41:38 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:38 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276896000 ms
18/10/23 14:41:39 INFO scheduler.JobScheduler: Added jobs for time 1540276899000 ms
18/10/23 14:41:39 INFO scheduler.JobScheduler: Starting job streaming job 1540276899000 ms.0 from job set of time 1540276899000 ms
18/10/23 14:41:39 INFO scheduler.JobScheduler: Finished job streaming job 1540276899000 ms.0 from job set of time 1540276899000 ms
18/10/23 14:41:39 INFO kafka010.KafkaRDD: Removing RDD 42 from persistence list
18/10/23 14:41:39 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276899000 ms (execution: 0.000 s)
18/10/23 14:41:39 INFO storage.BlockManager: Removing RDD 42
18/10/23 14:41:39 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:39 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276897000 ms
18/10/23 14:41:40 INFO scheduler.JobScheduler: Added jobs for time 1540276900000 ms
18/10/23 14:41:40 INFO scheduler.JobScheduler: Starting job streaming job 1540276900000 ms.0 from job set of time 1540276900000 ms
18/10/23 14:41:40 INFO scheduler.JobScheduler: Finished job streaming job 1540276900000 ms.0 from job set of time 1540276900000 ms
18/10/23 14:41:40 INFO kafka010.KafkaRDD: Removing RDD 43 from persistence list
18/10/23 14:41:40 INFO scheduler.JobScheduler: Total delay: 0.005 s for time 1540276900000 ms (execution: 0.000 s)
18/10/23 14:41:40 INFO storage.BlockManager: Removing RDD 43
18/10/23 14:41:40 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:40 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276898000 ms
18/10/23 14:41:41 INFO scheduler.JobScheduler: Added jobs for time 1540276901000 ms
18/10/23 14:41:41 INFO scheduler.JobScheduler: Starting job streaming job 1540276901000 ms.0 from job set of time 1540276901000 ms
18/10/23 14:41:41 INFO scheduler.JobScheduler: Finished job streaming job 1540276901000 ms.0 from job set of time 1540276901000 ms
18/10/23 14:41:41 INFO kafka010.KafkaRDD: Removing RDD 44 from persistence list
18/10/23 14:41:41 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276901000 ms (execution: 0.000 s)
18/10/23 14:41:41 INFO storage.BlockManager: Removing RDD 44
18/10/23 14:41:41 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:41 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276899000 ms
18/10/23 14:41:42 INFO scheduler.JobScheduler: Added jobs for time 1540276902000 ms
18/10/23 14:41:42 INFO scheduler.JobScheduler: Starting job streaming job 1540276902000 ms.0 from job set of time 1540276902000 ms
18/10/23 14:41:42 INFO scheduler.JobScheduler: Finished job streaming job 1540276902000 ms.0 from job set of time 1540276902000 ms
18/10/23 14:41:42 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276902000 ms (execution: 0.000 s)
18/10/23 14:41:42 INFO kafka010.KafkaRDD: Removing RDD 45 from persistence list
18/10/23 14:41:42 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:42 INFO storage.BlockManager: Removing RDD 45
18/10/23 14:41:42 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276900000 ms
18/10/23 14:41:43 INFO scheduler.JobScheduler: Added jobs for time 1540276903000 ms
18/10/23 14:41:43 INFO scheduler.JobScheduler: Starting job streaming job 1540276903000 ms.0 from job set of time 1540276903000 ms
18/10/23 14:41:43 INFO scheduler.JobScheduler: Finished job streaming job 1540276903000 ms.0 from job set of time 1540276903000 ms
18/10/23 14:41:43 INFO kafka010.KafkaRDD: Removing RDD 46 from persistence list
18/10/23 14:41:43 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276903000 ms (execution: 0.000 s)
18/10/23 14:41:43 INFO storage.BlockManager: Removing RDD 46
18/10/23 14:41:43 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:43 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276901000 ms
18/10/23 14:41:44 INFO scheduler.JobScheduler: Added jobs for time 1540276904000 ms
18/10/23 14:41:44 INFO scheduler.JobScheduler: Starting job streaming job 1540276904000 ms.0 from job set of time 1540276904000 ms
18/10/23 14:41:44 INFO scheduler.JobScheduler: Finished job streaming job 1540276904000 ms.0 from job set of time 1540276904000 ms
18/10/23 14:41:44 INFO kafka010.KafkaRDD: Removing RDD 47 from persistence list
18/10/23 14:41:44 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276904000 ms (execution: 0.000 s)
18/10/23 14:41:44 INFO storage.BlockManager: Removing RDD 47
18/10/23 14:41:44 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:44 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276902000 ms
18/10/23 14:41:45 INFO scheduler.JobScheduler: Added jobs for time 1540276905000 ms
18/10/23 14:41:45 INFO scheduler.JobScheduler: Starting job streaming job 1540276905000 ms.0 from job set of time 1540276905000 ms
18/10/23 14:41:45 INFO scheduler.JobScheduler: Finished job streaming job 1540276905000 ms.0 from job set of time 1540276905000 ms
18/10/23 14:41:45 INFO scheduler.JobScheduler: Total delay: 0.005 s for time 1540276905000 ms (execution: 0.000 s)
18/10/23 14:41:45 INFO kafka010.KafkaRDD: Removing RDD 48 from persistence list
18/10/23 14:41:45 INFO storage.BlockManager: Removing RDD 48
18/10/23 14:41:45 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:45 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276903000 ms
18/10/23 14:41:46 INFO scheduler.JobScheduler: Added jobs for time 1540276906000 ms
18/10/23 14:41:46 INFO scheduler.JobScheduler: Starting job streaming job 1540276906000 ms.0 from job set of time 1540276906000 ms
18/10/23 14:41:46 INFO scheduler.JobScheduler: Finished job streaming job 1540276906000 ms.0 from job set of time 1540276906000 ms
18/10/23 14:41:46 INFO kafka010.KafkaRDD: Removing RDD 49 from persistence list
18/10/23 14:41:46 INFO scheduler.JobScheduler: Total delay: 0.005 s for time 1540276906000 ms (execution: 0.001 s)
18/10/23 14:41:46 INFO storage.BlockManager: Removing RDD 49
18/10/23 14:41:46 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:46 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276904000 ms
18/10/23 14:41:47 INFO scheduler.JobScheduler: Added jobs for time 1540276907000 ms
18/10/23 14:41:47 INFO scheduler.JobScheduler: Starting job streaming job 1540276907000 ms.0 from job set of time 1540276907000 ms
18/10/23 14:41:47 INFO scheduler.JobScheduler: Finished job streaming job 1540276907000 ms.0 from job set of time 1540276907000 ms
18/10/23 14:41:47 INFO scheduler.JobScheduler: Total delay: 0.005 s for time 1540276907000 ms (execution: 0.000 s)
18/10/23 14:41:47 INFO kafka010.KafkaRDD: Removing RDD 50 from persistence list
18/10/23 14:41:47 INFO storage.BlockManager: Removing RDD 50
18/10/23 14:41:47 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:47 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276905000 ms
18/10/23 14:41:48 INFO scheduler.JobScheduler: Added jobs for time 1540276908000 ms
18/10/23 14:41:48 INFO scheduler.JobScheduler: Starting job streaming job 1540276908000 ms.0 from job set of time 1540276908000 ms
18/10/23 14:41:48 INFO scheduler.JobScheduler: Finished job streaming job 1540276908000 ms.0 from job set of time 1540276908000 ms
18/10/23 14:41:48 INFO kafka010.KafkaRDD: Removing RDD 51 from persistence list
18/10/23 14:41:48 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276908000 ms (execution: 0.001 s)
18/10/23 14:41:48 INFO storage.BlockManager: Removing RDD 51
18/10/23 14:41:48 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:48 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276906000 ms
18/10/23 14:41:49 INFO scheduler.JobScheduler: Added jobs for time 1540276909000 ms
18/10/23 14:41:49 INFO scheduler.JobScheduler: Starting job streaming job 1540276909000 ms.0 from job set of time 1540276909000 ms
18/10/23 14:41:49 INFO scheduler.JobScheduler: Finished job streaming job 1540276909000 ms.0 from job set of time 1540276909000 ms
18/10/23 14:41:49 INFO kafka010.KafkaRDD: Removing RDD 52 from persistence list
18/10/23 14:41:49 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276909000 ms (execution: 0.000 s)
18/10/23 14:41:49 INFO storage.BlockManager: Removing RDD 52
18/10/23 14:41:49 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:49 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276907000 ms
18/10/23 14:41:50 INFO scheduler.JobScheduler: Added jobs for time 1540276910000 ms
18/10/23 14:41:50 INFO scheduler.JobScheduler: Starting job streaming job 1540276910000 ms.0 from job set of time 1540276910000 ms
18/10/23 14:41:50 INFO scheduler.JobScheduler: Finished job streaming job 1540276910000 ms.0 from job set of time 1540276910000 ms
18/10/23 14:41:50 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276910000 ms (execution: 0.000 s)
18/10/23 14:41:50 INFO kafka010.KafkaRDD: Removing RDD 53 from persistence list
18/10/23 14:41:50 INFO storage.BlockManager: Removing RDD 53
18/10/23 14:41:50 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:50 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276908000 ms
18/10/23 14:41:51 INFO scheduler.JobScheduler: Added jobs for time 1540276911000 ms
18/10/23 14:41:51 INFO scheduler.JobScheduler: Starting job streaming job 1540276911000 ms.0 from job set of time 1540276911000 ms
18/10/23 14:41:51 INFO scheduler.JobScheduler: Finished job streaming job 1540276911000 ms.0 from job set of time 1540276911000 ms
18/10/23 14:41:51 INFO kafka010.KafkaRDD: Removing RDD 54 from persistence list
18/10/23 14:41:51 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276911000 ms (execution: 0.000 s)
18/10/23 14:41:51 INFO storage.BlockManager: Removing RDD 54
18/10/23 14:41:51 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:51 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276909000 ms
18/10/23 14:41:52 INFO scheduler.JobScheduler: Added jobs for time 1540276912000 ms
18/10/23 14:41:52 INFO scheduler.JobScheduler: Starting job streaming job 1540276912000 ms.0 from job set of time 1540276912000 ms
18/10/23 14:41:52 INFO scheduler.JobScheduler: Finished job streaming job 1540276912000 ms.0 from job set of time 1540276912000 ms
18/10/23 14:41:52 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276912000 ms (execution: 0.000 s)
18/10/23 14:41:52 INFO kafka010.KafkaRDD: Removing RDD 55 from persistence list
18/10/23 14:41:52 INFO storage.BlockManager: Removing RDD 55
18/10/23 14:41:52 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:52 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276910000 ms
18/10/23 14:41:53 INFO scheduler.JobScheduler: Added jobs for time 1540276913000 ms
18/10/23 14:41:53 INFO scheduler.JobScheduler: Starting job streaming job 1540276913000 ms.0 from job set of time 1540276913000 ms
18/10/23 14:41:53 INFO scheduler.JobScheduler: Finished job streaming job 1540276913000 ms.0 from job set of time 1540276913000 ms
18/10/23 14:41:53 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276913000 ms (execution: 0.000 s)
18/10/23 14:41:53 INFO kafka010.KafkaRDD: Removing RDD 56 from persistence list
18/10/23 14:41:53 INFO storage.BlockManager: Removing RDD 56
18/10/23 14:41:53 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:53 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276911000 ms
18/10/23 14:41:54 INFO scheduler.JobScheduler: Added jobs for time 1540276914000 ms
18/10/23 14:41:54 INFO scheduler.JobScheduler: Starting job streaming job 1540276914000 ms.0 from job set of time 1540276914000 ms
18/10/23 14:41:54 INFO scheduler.JobScheduler: Finished job streaming job 1540276914000 ms.0 from job set of time 1540276914000 ms
18/10/23 14:41:54 INFO kafka010.KafkaRDD: Removing RDD 57 from persistence list
18/10/23 14:41:54 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276914000 ms (execution: 0.000 s)
18/10/23 14:41:54 INFO storage.BlockManager: Removing RDD 57
18/10/23 14:41:54 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:54 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276912000 ms
18/10/23 14:41:55 INFO scheduler.JobScheduler: Added jobs for time 1540276915000 ms
18/10/23 14:41:55 INFO scheduler.JobScheduler: Starting job streaming job 1540276915000 ms.0 from job set of time 1540276915000 ms
18/10/23 14:41:55 INFO scheduler.JobScheduler: Finished job streaming job 1540276915000 ms.0 from job set of time 1540276915000 ms
18/10/23 14:41:55 INFO kafka010.KafkaRDD: Removing RDD 58 from persistence list
18/10/23 14:41:55 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276915000 ms (execution: 0.000 s)
18/10/23 14:41:55 INFO storage.BlockManager: Removing RDD 58
18/10/23 14:41:55 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:55 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276913000 ms
18/10/23 14:41:56 INFO scheduler.JobScheduler: Added jobs for time 1540276916000 ms
18/10/23 14:41:56 INFO scheduler.JobScheduler: Starting job streaming job 1540276916000 ms.0 from job set of time 1540276916000 ms
18/10/23 14:41:56 INFO scheduler.JobScheduler: Finished job streaming job 1540276916000 ms.0 from job set of time 1540276916000 ms
18/10/23 14:41:56 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276916000 ms (execution: 0.000 s)
18/10/23 14:41:56 INFO kafka010.KafkaRDD: Removing RDD 59 from persistence list
18/10/23 14:41:56 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:56 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276914000 ms
18/10/23 14:41:56 INFO storage.BlockManager: Removing RDD 59
18/10/23 14:41:57 INFO scheduler.JobScheduler: Added jobs for time 1540276917000 ms
18/10/23 14:41:57 INFO scheduler.JobScheduler: Starting job streaming job 1540276917000 ms.0 from job set of time 1540276917000 ms
18/10/23 14:41:57 INFO scheduler.JobScheduler: Finished job streaming job 1540276917000 ms.0 from job set of time 1540276917000 ms
18/10/23 14:41:57 INFO kafka010.KafkaRDD: Removing RDD 60 from persistence list
18/10/23 14:41:57 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276917000 ms (execution: 0.000 s)
18/10/23 14:41:57 INFO storage.BlockManager: Removing RDD 60
18/10/23 14:41:57 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:57 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276915000 ms
18/10/23 14:41:58 INFO scheduler.JobScheduler: Added jobs for time 1540276918000 ms
18/10/23 14:41:58 INFO scheduler.JobScheduler: Starting job streaming job 1540276918000 ms.0 from job set of time 1540276918000 ms
18/10/23 14:41:58 INFO scheduler.JobScheduler: Finished job streaming job 1540276918000 ms.0 from job set of time 1540276918000 ms
18/10/23 14:41:58 INFO kafka010.KafkaRDD: Removing RDD 61 from persistence list
18/10/23 14:41:58 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276918000 ms (execution: 0.000 s)
18/10/23 14:41:58 INFO storage.BlockManager: Removing RDD 61
18/10/23 14:41:58 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:58 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276916000 ms
18/10/23 14:41:59 INFO scheduler.JobScheduler: Added jobs for time 1540276919000 ms
18/10/23 14:41:59 INFO scheduler.JobScheduler: Starting job streaming job 1540276919000 ms.0 from job set of time 1540276919000 ms
18/10/23 14:41:59 INFO scheduler.JobScheduler: Finished job streaming job 1540276919000 ms.0 from job set of time 1540276919000 ms
18/10/23 14:41:59 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276919000 ms (execution: 0.000 s)
18/10/23 14:41:59 INFO kafka010.KafkaRDD: Removing RDD 62 from persistence list
18/10/23 14:41:59 INFO storage.BlockManager: Removing RDD 62
18/10/23 14:41:59 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:41:59 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276917000 ms
18/10/23 14:42:00 INFO scheduler.JobScheduler: Added jobs for time 1540276920000 ms
18/10/23 14:42:00 INFO scheduler.JobScheduler: Starting job streaming job 1540276920000 ms.0 from job set of time 1540276920000 ms
18/10/23 14:42:00 INFO scheduler.JobScheduler: Finished job streaming job 1540276920000 ms.0 from job set of time 1540276920000 ms
18/10/23 14:42:00 INFO kafka010.KafkaRDD: Removing RDD 63 from persistence list
18/10/23 14:42:00 INFO scheduler.JobScheduler: Total delay: 0.005 s for time 1540276920000 ms (execution: 0.001 s)
18/10/23 14:42:00 INFO storage.BlockManager: Removing RDD 63
18/10/23 14:42:00 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:42:00 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276918000 ms
18/10/23 14:42:01 INFO scheduler.JobScheduler: Added jobs for time 1540276921000 ms
18/10/23 14:42:01 INFO scheduler.JobScheduler: Starting job streaming job 1540276921000 ms.0 from job set of time 1540276921000 ms
18/10/23 14:42:01 INFO scheduler.JobScheduler: Finished job streaming job 1540276921000 ms.0 from job set of time 1540276921000 ms
18/10/23 14:42:01 INFO kafka010.KafkaRDD: Removing RDD 64 from persistence list
18/10/23 14:42:01 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276921000 ms (execution: 0.000 s)
18/10/23 14:42:01 INFO storage.BlockManager: Removing RDD 64
18/10/23 14:42:01 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:42:01 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276919000 ms
18/10/23 14:42:02 INFO scheduler.JobScheduler: Added jobs for time 1540276922000 ms
18/10/23 14:42:02 INFO scheduler.JobScheduler: Starting job streaming job 1540276922000 ms.0 from job set of time 1540276922000 ms
18/10/23 14:42:02 INFO scheduler.JobScheduler: Finished job streaming job 1540276922000 ms.0 from job set of time 1540276922000 ms
18/10/23 14:42:02 INFO kafka010.KafkaRDD: Removing RDD 65 from persistence list
18/10/23 14:42:02 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276922000 ms (execution: 0.001 s)
18/10/23 14:42:02 INFO storage.BlockManager: Removing RDD 65
18/10/23 14:42:02 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:42:02 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276920000 ms
18/10/23 14:42:03 INFO scheduler.JobScheduler: Added jobs for time 1540276923000 ms
18/10/23 14:42:03 INFO scheduler.JobScheduler: Starting job streaming job 1540276923000 ms.0 from job set of time 1540276923000 ms
18/10/23 14:42:03 INFO scheduler.JobScheduler: Finished job streaming job 1540276923000 ms.0 from job set of time 1540276923000 ms
18/10/23 14:42:03 INFO scheduler.JobScheduler: Total delay: 0.005 s for time 1540276923000 ms (execution: 0.000 s)
18/10/23 14:42:03 INFO kafka010.KafkaRDD: Removing RDD 66 from persistence list
18/10/23 14:42:03 INFO storage.BlockManager: Removing RDD 66
18/10/23 14:42:03 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:42:03 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276921000 ms
18/10/23 14:42:04 INFO scheduler.JobScheduler: Added jobs for time 1540276924000 ms
18/10/23 14:42:04 INFO scheduler.JobScheduler: Starting job streaming job 1540276924000 ms.0 from job set of time 1540276924000 ms
18/10/23 14:42:04 INFO scheduler.JobScheduler: Finished job streaming job 1540276924000 ms.0 from job set of time 1540276924000 ms
18/10/23 14:42:04 INFO kafka010.KafkaRDD: Removing RDD 67 from persistence list
18/10/23 14:42:04 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276924000 ms (execution: 0.000 s)
18/10/23 14:42:04 INFO storage.BlockManager: Removing RDD 67
18/10/23 14:42:04 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:42:04 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276922000 ms
18/10/23 14:42:05 INFO scheduler.JobScheduler: Added jobs for time 1540276925000 ms
18/10/23 14:42:05 INFO scheduler.JobScheduler: Starting job streaming job 1540276925000 ms.0 from job set of time 1540276925000 ms
18/10/23 14:42:05 INFO scheduler.JobScheduler: Finished job streaming job 1540276925000 ms.0 from job set of time 1540276925000 ms
18/10/23 14:42:05 INFO kafka010.KafkaRDD: Removing RDD 68 from persistence list
18/10/23 14:42:05 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276925000 ms (execution: 0.000 s)
18/10/23 14:42:05 INFO storage.BlockManager: Removing RDD 68
18/10/23 14:42:05 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:42:05 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276923000 ms
18/10/23 14:42:06 INFO scheduler.JobScheduler: Added jobs for time 1540276926000 ms
18/10/23 14:42:06 INFO scheduler.JobScheduler: Starting job streaming job 1540276926000 ms.0 from job set of time 1540276926000 ms
18/10/23 14:42:06 INFO scheduler.JobScheduler: Finished job streaming job 1540276926000 ms.0 from job set of time 1540276926000 ms
18/10/23 14:42:06 INFO kafka010.KafkaRDD: Removing RDD 69 from persistence list
18/10/23 14:42:06 INFO scheduler.JobScheduler: Total delay: 0.005 s for time 1540276926000 ms (execution: 0.001 s)
18/10/23 14:42:06 INFO storage.BlockManager: Removing RDD 69
18/10/23 14:42:06 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:42:06 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276924000 ms
18/10/23 14:42:07 INFO scheduler.JobScheduler: Added jobs for time 1540276927000 ms
18/10/23 14:42:07 INFO scheduler.JobScheduler: Starting job streaming job 1540276927000 ms.0 from job set of time 1540276927000 ms
18/10/23 14:42:07 INFO scheduler.JobScheduler: Finished job streaming job 1540276927000 ms.0 from job set of time 1540276927000 ms
18/10/23 14:42:07 INFO kafka010.KafkaRDD: Removing RDD 70 from persistence list
18/10/23 14:42:07 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276927000 ms (execution: 0.000 s)
18/10/23 14:42:07 INFO storage.BlockManager: Removing RDD 70
18/10/23 14:42:07 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:42:07 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276925000 ms
18/10/23 14:42:08 INFO scheduler.JobScheduler: Added jobs for time 1540276928000 ms
18/10/23 14:42:08 INFO scheduler.JobScheduler: Starting job streaming job 1540276928000 ms.0 from job set of time 1540276928000 ms
18/10/23 14:42:08 INFO scheduler.JobScheduler: Finished job streaming job 1540276928000 ms.0 from job set of time 1540276928000 ms
18/10/23 14:42:08 INFO scheduler.JobScheduler: Total delay: 0.003 s for time 1540276928000 ms (execution: 0.000 s)
18/10/23 14:42:08 INFO kafka010.KafkaRDD: Removing RDD 71 from persistence list
18/10/23 14:42:08 INFO storage.BlockManager: Removing RDD 71
18/10/23 14:42:08 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:42:08 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276926000 ms
18/10/23 14:42:09 INFO scheduler.JobScheduler: Added jobs for time 1540276929000 ms
18/10/23 14:42:09 INFO scheduler.JobScheduler: Starting job streaming job 1540276929000 ms.0 from job set of time 1540276929000 ms
18/10/23 14:42:09 INFO scheduler.JobScheduler: Finished job streaming job 1540276929000 ms.0 from job set of time 1540276929000 ms
18/10/23 14:42:09 INFO kafka010.KafkaRDD: Removing RDD 72 from persistence list
18/10/23 14:42:09 INFO scheduler.JobScheduler: Total delay: 0.003 s for time 1540276929000 ms (execution: 0.000 s)
18/10/23 14:42:09 INFO storage.BlockManager: Removing RDD 72
18/10/23 14:42:09 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:42:09 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276927000 ms
18/10/23 14:42:10 INFO scheduler.JobScheduler: Added jobs for time 1540276930000 ms
18/10/23 14:42:10 INFO scheduler.JobScheduler: Starting job streaming job 1540276930000 ms.0 from job set of time 1540276930000 ms
18/10/23 14:42:10 INFO scheduler.JobScheduler: Finished job streaming job 1540276930000 ms.0 from job set of time 1540276930000 ms
18/10/23 14:42:10 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276930000 ms (execution: 0.001 s)
18/10/23 14:42:10 INFO kafka010.KafkaRDD: Removing RDD 73 from persistence list
18/10/23 14:42:10 INFO storage.BlockManager: Removing RDD 73
18/10/23 14:42:10 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:42:10 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276928000 ms
18/10/23 14:42:11 INFO scheduler.JobScheduler: Added jobs for time 1540276931000 ms
18/10/23 14:42:11 INFO scheduler.JobScheduler: Starting job streaming job 1540276931000 ms.0 from job set of time 1540276931000 ms
18/10/23 14:42:11 INFO scheduler.JobScheduler: Finished job streaming job 1540276931000 ms.0 from job set of time 1540276931000 ms
18/10/23 14:42:11 INFO kafka010.KafkaRDD: Removing RDD 74 from persistence list
18/10/23 14:42:11 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276931000 ms (execution: 0.000 s)
18/10/23 14:42:11 INFO storage.BlockManager: Removing RDD 74
18/10/23 14:42:11 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:42:11 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276929000 ms
18/10/23 14:42:12 INFO scheduler.JobScheduler: Added jobs for time 1540276932000 ms
18/10/23 14:42:12 INFO scheduler.JobScheduler: Starting job streaming job 1540276932000 ms.0 from job set of time 1540276932000 ms
18/10/23 14:42:12 INFO scheduler.JobScheduler: Finished job streaming job 1540276932000 ms.0 from job set of time 1540276932000 ms
18/10/23 14:42:12 INFO kafka010.KafkaRDD: Removing RDD 75 from persistence list
18/10/23 14:42:12 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276932000 ms (execution: 0.000 s)
18/10/23 14:42:12 INFO storage.BlockManager: Removing RDD 75
18/10/23 14:42:12 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:42:12 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276930000 ms
18/10/23 14:42:13 INFO scheduler.JobScheduler: Added jobs for time 1540276933000 ms
18/10/23 14:42:13 INFO scheduler.JobScheduler: Starting job streaming job 1540276933000 ms.0 from job set of time 1540276933000 ms
18/10/23 14:42:13 INFO scheduler.JobScheduler: Finished job streaming job 1540276933000 ms.0 from job set of time 1540276933000 ms
18/10/23 14:42:13 INFO kafka010.KafkaRDD: Removing RDD 76 from persistence list
18/10/23 14:42:13 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276933000 ms (execution: 0.001 s)
18/10/23 14:42:13 INFO storage.BlockManager: Removing RDD 76
18/10/23 14:42:13 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:42:13 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276931000 ms
18/10/23 14:42:14 INFO scheduler.JobScheduler: Added jobs for time 1540276934000 ms
18/10/23 14:42:14 INFO scheduler.JobScheduler: Starting job streaming job 1540276934000 ms.0 from job set of time 1540276934000 ms
18/10/23 14:42:14 INFO scheduler.JobScheduler: Finished job streaming job 1540276934000 ms.0 from job set of time 1540276934000 ms
18/10/23 14:42:14 INFO kafka010.KafkaRDD: Removing RDD 77 from persistence list
18/10/23 14:42:14 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276934000 ms (execution: 0.001 s)
18/10/23 14:42:14 INFO storage.BlockManager: Removing RDD 77
18/10/23 14:42:14 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:42:14 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276932000 ms
18/10/23 14:42:15 INFO scheduler.JobScheduler: Added jobs for time 1540276935000 ms
18/10/23 14:42:15 INFO scheduler.JobScheduler: Starting job streaming job 1540276935000 ms.0 from job set of time 1540276935000 ms
18/10/23 14:42:15 INFO scheduler.JobScheduler: Finished job streaming job 1540276935000 ms.0 from job set of time 1540276935000 ms
18/10/23 14:42:15 INFO scheduler.JobScheduler: Total delay: 0.005 s for time 1540276935000 ms (execution: 0.001 s)
18/10/23 14:42:15 INFO kafka010.KafkaRDD: Removing RDD 78 from persistence list
18/10/23 14:42:15 INFO storage.BlockManager: Removing RDD 78
18/10/23 14:42:15 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:42:15 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276933000 ms
18/10/23 14:42:16 INFO scheduler.JobScheduler: Added jobs for time 1540276936000 ms
18/10/23 14:42:16 INFO scheduler.JobScheduler: Starting job streaming job 1540276936000 ms.0 from job set of time 1540276936000 ms
18/10/23 14:42:16 INFO scheduler.JobScheduler: Finished job streaming job 1540276936000 ms.0 from job set of time 1540276936000 ms
18/10/23 14:42:16 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276936000 ms (execution: 0.000 s)
18/10/23 14:42:16 INFO kafka010.KafkaRDD: Removing RDD 79 from persistence list
18/10/23 14:42:16 INFO storage.BlockManager: Removing RDD 79
18/10/23 14:42:16 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:42:16 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276934000 ms
18/10/23 14:42:17 INFO scheduler.JobScheduler: Added jobs for time 1540276937000 ms
18/10/23 14:42:17 INFO scheduler.JobScheduler: Starting job streaming job 1540276937000 ms.0 from job set of time 1540276937000 ms
18/10/23 14:42:17 INFO scheduler.JobScheduler: Finished job streaming job 1540276937000 ms.0 from job set of time 1540276937000 ms
18/10/23 14:42:17 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276937000 ms (execution: 0.000 s)
18/10/23 14:42:17 INFO kafka010.KafkaRDD: Removing RDD 80 from persistence list
18/10/23 14:42:17 INFO storage.BlockManager: Removing RDD 80
18/10/23 14:42:17 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:42:17 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276935000 ms
18/10/23 14:42:18 INFO scheduler.JobScheduler: Added jobs for time 1540276938000 ms
18/10/23 14:42:18 INFO scheduler.JobScheduler: Starting job streaming job 1540276938000 ms.0 from job set of time 1540276938000 ms
18/10/23 14:42:18 INFO scheduler.JobScheduler: Finished job streaming job 1540276938000 ms.0 from job set of time 1540276938000 ms
18/10/23 14:42:18 INFO kafka010.KafkaRDD: Removing RDD 81 from persistence list
18/10/23 14:42:18 INFO scheduler.JobScheduler: Total delay: 0.003 s for time 1540276938000 ms (execution: 0.000 s)
18/10/23 14:42:18 INFO storage.BlockManager: Removing RDD 81
18/10/23 14:42:18 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:42:18 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276936000 ms
18/10/23 14:42:19 INFO scheduler.JobScheduler: Added jobs for time 1540276939000 ms
18/10/23 14:42:19 INFO scheduler.JobScheduler: Starting job streaming job 1540276939000 ms.0 from job set of time 1540276939000 ms
18/10/23 14:42:19 INFO scheduler.JobScheduler: Finished job streaming job 1540276939000 ms.0 from job set of time 1540276939000 ms
18/10/23 14:42:19 INFO scheduler.JobScheduler: Total delay: 0.003 s for time 1540276939000 ms (execution: 0.000 s)
18/10/23 14:42:19 INFO kafka010.KafkaRDD: Removing RDD 82 from persistence list
18/10/23 14:42:19 INFO storage.BlockManager: Removing RDD 82
18/10/23 14:42:19 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:42:19 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276937000 ms
18/10/23 14:42:20 INFO scheduler.JobScheduler: Added jobs for time 1540276940000 ms
18/10/23 14:42:20 INFO scheduler.JobScheduler: Starting job streaming job 1540276940000 ms.0 from job set of time 1540276940000 ms
18/10/23 14:42:20 INFO scheduler.JobScheduler: Finished job streaming job 1540276940000 ms.0 from job set of time 1540276940000 ms
18/10/23 14:42:20 INFO kafka010.KafkaRDD: Removing RDD 83 from persistence list
18/10/23 14:42:20 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276940000 ms (execution: 0.000 s)
18/10/23 14:42:20 INFO storage.BlockManager: Removing RDD 83
18/10/23 14:42:20 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:42:20 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276938000 ms
18/10/23 14:42:21 INFO scheduler.JobScheduler: Added jobs for time 1540276941000 ms
18/10/23 14:42:21 INFO scheduler.JobScheduler: Starting job streaming job 1540276941000 ms.0 from job set of time 1540276941000 ms
18/10/23 14:42:21 INFO scheduler.JobScheduler: Finished job streaming job 1540276941000 ms.0 from job set of time 1540276941000 ms
18/10/23 14:42:21 INFO kafka010.KafkaRDD: Removing RDD 84 from persistence list
18/10/23 14:42:21 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276941000 ms (execution: 0.000 s)
18/10/23 14:42:21 INFO storage.BlockManager: Removing RDD 84
18/10/23 14:42:21 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:42:21 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276939000 ms
18/10/23 14:42:22 INFO scheduler.JobScheduler: Added jobs for time 1540276942000 ms
18/10/23 14:42:22 INFO scheduler.JobScheduler: Starting job streaming job 1540276942000 ms.0 from job set of time 1540276942000 ms
18/10/23 14:42:22 INFO scheduler.JobScheduler: Finished job streaming job 1540276942000 ms.0 from job set of time 1540276942000 ms
18/10/23 14:42:22 INFO kafka010.KafkaRDD: Removing RDD 85 from persistence list
18/10/23 14:42:22 INFO scheduler.JobScheduler: Total delay: 0.003 s for time 1540276942000 ms (execution: 0.000 s)
18/10/23 14:42:22 INFO storage.BlockManager: Removing RDD 85
18/10/23 14:42:22 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:42:22 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276940000 ms
18/10/23 14:42:23 INFO scheduler.JobScheduler: Added jobs for time 1540276943000 ms
18/10/23 14:42:23 INFO scheduler.JobScheduler: Starting job streaming job 1540276943000 ms.0 from job set of time 1540276943000 ms
18/10/23 14:42:23 INFO scheduler.JobScheduler: Finished job streaming job 1540276943000 ms.0 from job set of time 1540276943000 ms
18/10/23 14:42:23 INFO kafka010.KafkaRDD: Removing RDD 86 from persistence list
18/10/23 14:42:23 INFO scheduler.JobScheduler: Total delay: 0.003 s for time 1540276943000 ms (execution: 0.000 s)
18/10/23 14:42:23 INFO storage.BlockManager: Removing RDD 86
18/10/23 14:42:23 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:42:23 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276941000 ms
18/10/23 14:42:24 INFO scheduler.JobScheduler: Added jobs for time 1540276944000 ms
18/10/23 14:42:24 INFO scheduler.JobScheduler: Starting job streaming job 1540276944000 ms.0 from job set of time 1540276944000 ms
18/10/23 14:42:24 INFO scheduler.JobScheduler: Finished job streaming job 1540276944000 ms.0 from job set of time 1540276944000 ms
18/10/23 14:42:24 INFO kafka010.KafkaRDD: Removing RDD 87 from persistence list
18/10/23 14:42:24 INFO scheduler.JobScheduler: Total delay: 0.003 s for time 1540276944000 ms (execution: 0.000 s)
18/10/23 14:42:24 INFO storage.BlockManager: Removing RDD 87
18/10/23 14:42:24 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:42:24 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276942000 ms
18/10/23 14:42:25 INFO scheduler.JobScheduler: Added jobs for time 1540276945000 ms
18/10/23 14:42:25 INFO scheduler.JobScheduler: Starting job streaming job 1540276945000 ms.0 from job set of time 1540276945000 ms
18/10/23 14:42:25 INFO scheduler.JobScheduler: Finished job streaming job 1540276945000 ms.0 from job set of time 1540276945000 ms
18/10/23 14:42:25 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276945000 ms (execution: 0.000 s)
18/10/23 14:42:25 INFO kafka010.KafkaRDD: Removing RDD 88 from persistence list
18/10/23 14:42:25 INFO storage.BlockManager: Removing RDD 88
18/10/23 14:42:25 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:42:25 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276943000 ms
18/10/23 14:42:26 INFO scheduler.JobScheduler: Added jobs for time 1540276946000 ms
18/10/23 14:42:26 INFO scheduler.JobScheduler: Starting job streaming job 1540276946000 ms.0 from job set of time 1540276946000 ms
18/10/23 14:42:26 INFO scheduler.JobScheduler: Finished job streaming job 1540276946000 ms.0 from job set of time 1540276946000 ms
18/10/23 14:42:26 INFO kafka010.KafkaRDD: Removing RDD 89 from persistence list
18/10/23 14:42:26 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276946000 ms (execution: 0.000 s)
18/10/23 14:42:26 INFO storage.BlockManager: Removing RDD 89
18/10/23 14:42:26 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:42:26 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276944000 ms
18/10/23 14:42:27 INFO scheduler.JobScheduler: Added jobs for time 1540276947000 ms
18/10/23 14:42:27 INFO scheduler.JobScheduler: Starting job streaming job 1540276947000 ms.0 from job set of time 1540276947000 ms
18/10/23 14:42:27 INFO scheduler.JobScheduler: Finished job streaming job 1540276947000 ms.0 from job set of time 1540276947000 ms
18/10/23 14:42:27 INFO scheduler.JobScheduler: Total delay: 0.003 s for time 1540276947000 ms (execution: 0.000 s)
18/10/23 14:42:27 INFO kafka010.KafkaRDD: Removing RDD 90 from persistence list
18/10/23 14:42:27 INFO storage.BlockManager: Removing RDD 90
18/10/23 14:42:27 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:42:27 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276945000 ms
18/10/23 14:42:28 INFO scheduler.JobScheduler: Added jobs for time 1540276948000 ms
18/10/23 14:42:28 INFO scheduler.JobScheduler: Starting job streaming job 1540276948000 ms.0 from job set of time 1540276948000 ms
18/10/23 14:42:28 INFO scheduler.JobScheduler: Finished job streaming job 1540276948000 ms.0 from job set of time 1540276948000 ms
18/10/23 14:42:28 INFO kafka010.KafkaRDD: Removing RDD 91 from persistence list
18/10/23 14:42:28 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276948000 ms (execution: 0.000 s)
18/10/23 14:42:28 INFO storage.BlockManager: Removing RDD 91
18/10/23 14:42:28 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:42:28 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276946000 ms
18/10/23 14:42:29 INFO scheduler.JobScheduler: Added jobs for time 1540276949000 ms
18/10/23 14:42:29 INFO scheduler.JobScheduler: Starting job streaming job 1540276949000 ms.0 from job set of time 1540276949000 ms
18/10/23 14:42:29 INFO scheduler.JobScheduler: Finished job streaming job 1540276949000 ms.0 from job set of time 1540276949000 ms
18/10/23 14:42:29 INFO kafka010.KafkaRDD: Removing RDD 92 from persistence list
18/10/23 14:42:29 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276949000 ms (execution: 0.000 s)
18/10/23 14:42:29 INFO storage.BlockManager: Removing RDD 92
18/10/23 14:42:29 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:42:29 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276947000 ms
18/10/23 14:42:30 INFO scheduler.JobScheduler: Added jobs for time 1540276950000 ms
18/10/23 14:42:30 INFO scheduler.JobScheduler: Starting job streaming job 1540276950000 ms.0 from job set of time 1540276950000 ms
18/10/23 14:42:30 INFO scheduler.JobScheduler: Finished job streaming job 1540276950000 ms.0 from job set of time 1540276950000 ms
18/10/23 14:42:30 INFO kafka010.KafkaRDD: Removing RDD 93 from persistence list
18/10/23 14:42:30 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276950000 ms (execution: 0.000 s)
18/10/23 14:42:30 INFO storage.BlockManager: Removing RDD 93
18/10/23 14:42:30 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:42:30 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276948000 ms
18/10/23 14:42:31 INFO scheduler.JobScheduler: Added jobs for time 1540276951000 ms
18/10/23 14:42:31 INFO scheduler.JobScheduler: Starting job streaming job 1540276951000 ms.0 from job set of time 1540276951000 ms
18/10/23 14:42:31 INFO scheduler.JobScheduler: Finished job streaming job 1540276951000 ms.0 from job set of time 1540276951000 ms
18/10/23 14:42:31 INFO scheduler.JobScheduler: Total delay: 0.005 s for time 1540276951000 ms (execution: 0.001 s)
18/10/23 14:42:31 INFO kafka010.KafkaRDD: Removing RDD 94 from persistence list
18/10/23 14:42:31 INFO storage.BlockManager: Removing RDD 94
18/10/23 14:42:31 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:42:31 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276949000 ms
18/10/23 14:42:32 INFO scheduler.JobScheduler: Added jobs for time 1540276952000 ms
18/10/23 14:42:32 INFO scheduler.JobScheduler: Starting job streaming job 1540276952000 ms.0 from job set of time 1540276952000 ms
18/10/23 14:42:32 INFO scheduler.JobScheduler: Finished job streaming job 1540276952000 ms.0 from job set of time 1540276952000 ms
18/10/23 14:42:32 INFO kafka010.KafkaRDD: Removing RDD 95 from persistence list
18/10/23 14:42:32 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276952000 ms (execution: 0.000 s)
18/10/23 14:42:32 INFO storage.BlockManager: Removing RDD 95
18/10/23 14:42:32 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:42:32 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276950000 ms
18/10/23 14:42:33 INFO scheduler.JobScheduler: Added jobs for time 1540276953000 ms
18/10/23 14:42:33 INFO scheduler.JobScheduler: Starting job streaming job 1540276953000 ms.0 from job set of time 1540276953000 ms
18/10/23 14:42:33 INFO scheduler.JobScheduler: Finished job streaming job 1540276953000 ms.0 from job set of time 1540276953000 ms
18/10/23 14:42:33 INFO kafka010.KafkaRDD: Removing RDD 96 from persistence list
18/10/23 14:42:33 INFO scheduler.JobScheduler: Total delay: 0.003 s for time 1540276953000 ms (execution: 0.000 s)
18/10/23 14:42:33 INFO storage.BlockManager: Removing RDD 96
18/10/23 14:42:33 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:42:33 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276951000 ms
18/10/23 14:42:34 INFO scheduler.JobScheduler: Added jobs for time 1540276954000 ms
18/10/23 14:42:34 INFO scheduler.JobScheduler: Starting job streaming job 1540276954000 ms.0 from job set of time 1540276954000 ms
18/10/23 14:42:34 INFO scheduler.JobScheduler: Finished job streaming job 1540276954000 ms.0 from job set of time 1540276954000 ms
18/10/23 14:42:34 INFO kafka010.KafkaRDD: Removing RDD 97 from persistence list
18/10/23 14:42:34 INFO scheduler.JobScheduler: Total delay: 0.004 s for time 1540276954000 ms (execution: 0.001 s)
18/10/23 14:42:34 INFO storage.BlockManager: Removing RDD 97
18/10/23 14:42:34 INFO scheduler.ReceivedBlockTracker: Deleting batches: 
18/10/23 14:42:34 INFO scheduler.InputInfoTracker: remove old batch metadata: 1540276952000 ms
18/10/23 14:42:34 ERROR yarn.ApplicationMaster: Uncaught exception: 
java.util.concurrent.TimeoutException: Futures timed out after [100000 milliseconds]
    at scala.concurrent.impl.Promise$DefaultPromise.ready(Promise.scala:219)
    at scala.concurrent.impl.Promise$DefaultPromise.result(Promise.scala:223)
    at org.apache.spark.util.ThreadUtils$.awaitResult(ThreadUtils.scala:201)
    at org.apache.spark.deploy.yarn.ApplicationMaster.runDriver(ApplicationMaster.scala:401)
    at org.apache.spark.deploy.yarn.ApplicationMaster.run(ApplicationMaster.scala:254)
    at org.apache.spark.deploy.yarn.ApplicationMaster$$anonfun$main$1.apply$mcV$sp(ApplicationMaster.scala:764)
    at org.apache.spark.deploy.SparkHadoopUtil$$anon$2.run(SparkHadoopUtil.scala:67)
    at org.apache.spark.deploy.SparkHadoopUtil$$anon$2.run(SparkHadoopUtil.scala:66)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:422)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698)
    at org.apache.spark.deploy.SparkHadoopUtil.runAsSparkUser(SparkHadoopUtil.scala:66)
    at org.apache.spark.deploy.yarn.ApplicationMaster$.main(ApplicationMaster.scala:762)
    at org.apache.spark.deploy.yarn.ApplicationMaster.main(ApplicationMaster.scala)
18/10/23 14:42:34 INFO yarn.ApplicationMaster: Final app status: FAILED, exitCode: 10, (reason: Uncaught exception: java.util.concurrent.TimeoutException: Futures timed out after [100000 milliseconds])
18/10/23 14:42:34 INFO streaming.StreamingContext: Invoking stop(stopGracefully=false) from shutdown hook
18/10/23 14:42:34 INFO scheduler.ReceiverTracker: ReceiverTracker stopped
18/10/23 14:42:34 INFO scheduler.JobGenerator: Stopping JobGenerator immediately
18/10/23 14:42:34 INFO util.RecurringTimer: Stopped timer for JobGenerator after time 1540276954000
18/10/23 14:42:34 INFO scheduler.JobGenerator: Stopped JobGenerator
18/10/23 14:42:34 INFO scheduler.JobScheduler: Stopped JobScheduler
18/10/23 14:42:34 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@8e1d9c1{/streaming,null,UNAVAILABLE,@Spark}
18/10/23 14:42:34 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@5ccd562a{/streaming/batch,null,UNAVAILABLE,@Spark}
18/10/23 14:42:34 INFO handler.ContextHandler: Stopped o.s.j.s.ServletContextHandler@4c9582f8{/static/streaming,null,UNAVAILABLE,@Spark}
18/10/23 14:42:34 INFO streaming.StreamingContext: StreamingContext stopped successfully
18/10/23 14:42:34 INFO spark.SparkContext: Invoking stop() from shutdown hook
18/10/23 14:42:34 INFO server.AbstractConnector: Stopped Spark@5a4f184{HTTP/1.1,[http/1.1]}{0.0.0.0:0}
18/10/23 14:42:34 INFO ui.SparkUI: Stopped Spark web UI at http://192.168.0.171:35555
18/10/23 14:42:34 INFO spark.MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
18/10/23 14:42:34 INFO memory.MemoryStore: MemoryStore cleared
18/10/23 14:42:34 INFO storage.BlockManager: BlockManager stopped
18/10/23 14:42:34 INFO storage.BlockManagerMaster: BlockManagerMaster stopped
18/10/23 14:42:34 INFO scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
18/10/23 14:42:34 INFO spark.SparkContext: Successfully stopped SparkContext
18/10/23 14:42:34 INFO yarn.ApplicationMaster: Unregistering ApplicationMaster with FAILED (diag message: Uncaught exception: java.util.concurrent.TimeoutException: Futures timed out after [100000 milliseconds])
18/10/23 14:42:34 INFO yarn.ApplicationMaster: Deleting staging directory hdfs://master:9000/user/root/.sparkStaging/application_1540265434662_0001
18/10/23 14:42:34 INFO util.ShutdownHookManager: Shutdown hook called
18/10/23 14:42:34 INFO util.ShutdownHookManager: Deleting directory /opt/hadoop-2.7.7/tmp/nm-local-dir/usercache/root/appcache/application_1540265434662_0001/spark-530a71e1-8d05-4730-9fe1-4a8494105c9f

最后

以上就是结实哈密瓜为你收集整理的5555的全部内容，希望文章能够帮你解决5555所遇到的程序开发问题。

如果觉得靠谱客网站的内容还不错，欢迎将靠谱客网站推荐给程序员好友。