You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-07-03 - 07:49

x86 Intel Atom E3845 @1915 MHz, Linux 4.19.37-rt20 (Profile)

Latency plot of system in rack #b, slot #6
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot6.osadl.org (updated Sun Jul 03, 2022 00:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2914421640,4sleep02783999cyclictest01:29:290
2903321610,3sleep22785199cyclictest23:46:552
911911600,4ptp4l401ktimersoftd/321:37:383
2856821600,5sleep12784499cyclictest00:54:481
77222920,2sleep00-21swapper/001:05:270
91191720,1ptp4l401ktimersoftd/302:07:343
225722670,1sleep00-21swapper/000:48:330
225722670,1sleep00-21swapper/000:48:330
38842650,2sleep10-21swapper/101:02:231
91191610,2ptp4l401ktimersoftd/302:26:063
91191610,1ptp4l401ktimersoftd/301:27:103
19502610,2sleep00-21swapper/002:08:110
277272604,10sleep10-21swapper/121:39:231
275102594,43sleep00-21swapper/021:36:310
91191580,1ptp4l401ktimersoftd/323:17:233
91191580,1ptp4l401ktimersoftd/302:35:143
91191570,1ptp4l401ktimersoftd/302:51:363
91191570,1ptp4l401ktimersoftd/302:20:593
91191570,1ptp4l401ktimersoftd/300:59:373
70112560,1sleep20-21swapper/202:13:442
327072500,1sleep00-21swapper/000:59:290
269562490,21sleep233-21ksoftirqd/200:19:362
33432480,2sleep10-21swapper/121:54:321
33432480,2sleep10-21swapper/121:54:321
91191470,1ptp4l401ktimersoftd/302:58:053
91191470,10ptp4l401ktimersoftd/300:25:083
27844994616,9cyclictest25-21ksoftirqd/122:54:501
91191450,2ptp4l20606-21kworker/3:202:18:283
91191450,2ptp4l20606-21kworker/3:202:18:283
27844994517,6cyclictest25-21ksoftirqd/100:09:521
2784499445,10cyclictest25-21ksoftirqd/103:04:581
91191430,1ptp4l401ktimersoftd/300:18:533
2784499433,8cyclictest5515-21cron21:59:311
27844994318,5cyclictest25-21ksoftirqd/123:39:531
2784499427,9cyclictest2396-21tune2fs01:34:521
2784499426,9cyclictest25-21ksoftirqd/102:14:371
2784499424,4cyclictest25-21ksoftirqd/122:54:331
27844994220,4cyclictest25-21ksoftirqd/122:04:461
27844994219,4cyclictest25-21ksoftirqd/123:19:531
27844994216,7cyclictest25-21ksoftirqd/122:14:541
91191410,1ptp4l401ktimersoftd/300:35:043
2784499417,7cyclictest25-21ksoftirqd/123:54:351
2784499414,9cyclictest25-21ksoftirqd/100:44:571
2784499414,9cyclictest25-21ksoftirqd/100:44:571
2784499412,10cyclictest25-21ksoftirqd/122:59:581
2784499411,8cyclictest25-21ksoftirqd/102:24:581
27844994118,10cyclictest25-21ksoftirqd/102:51:331
27844994117,10cyclictest25-21ksoftirqd/123:47:451
27844994116,8cyclictest25-21ksoftirqd/101:29:371
27844994115,10cyclictest25-21ksoftirqd/102:46:341
91191400,1ptp4l401ktimersoftd/323:04:473
91191400,1ptp4l401ktimersoftd/302:45:053
91191400,1ptp4l401ktimersoftd/301:49:463
91191400,1ptp4l401ktimersoftd/301:46:303
91191400,1ptp4l401ktimersoftd/301:40:063
91191400,1ptp4l401ktimersoftd/300:44:353
91191400,1ptp4l401ktimersoftd/300:22:293
91191400,1ptp4l401ktimersoftd/300:11:243
2784499407,7cyclictest25-21ksoftirqd/102:04:251
2784499406,9cyclictest17191-21sendmail00:09:351
2784499406,7cyclictest29643-21ssh01:29:481
2784499405,8cyclictest25-21ksoftirqd/101:09:551
2784499405,8cyclictest20845-21diskmemload01:24:111
2784499405,10cyclictest25-21ksoftirqd/121:59:521
2784499405,10cyclictest25-21ksoftirqd/100:34:571
2784499404,9cyclictest25-21ksoftirqd/123:09:561
2784499404,10cyclictest25-21ksoftirqd/101:43:181
2784499403,7cyclictest3706-21grep23:54:511
27844994017,6cyclictest25-21ksoftirqd/100:32:291
27844994016,4cyclictest25-21ksoftirqd/102:18:281
27844994016,4cyclictest25-21ksoftirqd/102:18:281
27844994015,10cyclictest25-21ksoftirqd/102:40:371
91191390,2ptp4l32096-21kworker/3:101:35:013
91191390,1ptp4l401ktimersoftd/303:00:063
91191390,1ptp4l401ktimersoftd/301:59:103
91191390,1ptp4l401ktimersoftd/300:00:063
91191390,0ptp4l401ktimersoftd/303:04:513
91191390,0ptp4l401ktimersoftd/301:17:403
91191390,0ptp4l401ktimersoftd/301:06:283
2784499399,9cyclictest19892-21cron22:29:321
2784499394,9cyclictest25-21ksoftirqd/101:50:061
2784499394,8cyclictest25-21ksoftirqd/102:20:011
2784499393,9cyclictest25-21ksoftirqd/122:19:511
2784499393,7cyclictest25-21ksoftirqd/102:35:081
2784499393,7cyclictest22707-21tr22:34:461
27844993915,8cyclictest25-21ksoftirqd/123:04:461
2784499390,6cyclictest241ktimersoftd/102:04:481
2784499390,13cyclictest25-21ksoftirqd/123:34:501
91191380,1ptp4l401ktimersoftd/323:59:003
91191380,1ptp4l401ktimersoftd/323:24:513
91191380,1ptp4l401ktimersoftd/323:24:513
91191380,1ptp4l401ktimersoftd/302:02:563
91191380,1ptp4l401ktimersoftd/301:19:443
91191380,1ptp4l401ktimersoftd/300:51:323
91191380,1ptp4l401ktimersoftd/300:47:033
91191380,1ptp4l401ktimersoftd/300:47:033
91191380,1ptp4l401ktimersoftd/300:30:143
91191380,1ptp4l401ktimersoftd/300:07:503
2784499386,9cyclictest25-21ksoftirqd/122:39:491
2784499386,8cyclictest25-21ksoftirqd/101:14:521
2784499386,8cyclictest14360-21tune2fs00:39:521
2784499386,5cyclictest25-21ksoftirqd/122:09:531
2784499385,8cyclictest25-21ksoftirqd/123:24:511
2784499385,8cyclictest25-21ksoftirqd/123:24:511
2784499385,8cyclictest25-21ksoftirqd/102:54:561
2784499385,7cyclictest25-21ksoftirqd/103:04:391
2784499385,5cyclictest25-21ksoftirqd/100:14:551
2784499385,11cyclictest25-21ksoftirqd/123:34:341
2784499383,9cyclictest25-21ksoftirqd/122:44:451
2784499382,7cyclictest25-21ksoftirqd/101:59:371
27844993818,10cyclictest25-21ksoftirqd/121:44:441
27844993817,8cyclictest25-21ksoftirqd/101:45:041
27844993815,9cyclictest25-21ksoftirqd/101:07:261
91191370,1ptp4l401ktimersoftd/323:52:583
91191370,1ptp4l401ktimersoftd/323:45:073
91191370,1ptp4l401ktimersoftd/323:34:583
91191370,1ptp4l401ktimersoftd/302:09:523
91191370,1ptp4l401ktimersoftd/301:11:583
2784499377,7cyclictest25-21ksoftirqd/122:34:331
2784499376,8cyclictest25-21ksoftirqd/123:59:541
2784499366,9cyclictest11303-21apt-config23:19:331
2784499366,8cyclictest25-21ksoftirqd/100:53:181
2784499365,4cyclictest25-21ksoftirqd/121:39:421
2784499361,9cyclictest25-21ksoftirqd/100:20:271
27844993612,7cyclictest25-21ksoftirqd/102:30:001
2767623616,8sleep20-21swapper/221:38:432
91191350,1ptp4l401ktimersoftd/323:41:253
320512350,2sleep20-21swapper/222:54:432
2784499352,8cyclictest25-21ksoftirqd/100:26:151
91191340,1ptp4l401ktimersoftd/322:04:543
91191340,1ptp4l401ktimersoftd/302:33:563
91191340,1ptp4l401ktimersoftd/301:32:413
91191340,11ptp4l401ktimersoftd/323:33:233
91191340,0ptp4l401ktimersoftd/300:55:273
91191330,1ptp4l401ktimersoftd/322:19:033
91191330,1ptp4l401ktimersoftd/321:59:433
91191330,11ptp4l401ktimersoftd/322:36:433
91191320,1ptp4l401ktimersoftd/323:19:343
91191320,1ptp4l401ktimersoftd/322:59:513
91191320,1ptp4l401ktimersoftd/322:46:363
91191310,1ptp4l401ktimersoftd/321:53:543
91191310,1ptp4l401ktimersoftd/321:53:543
91191300,1ptp4l401ktimersoftd/302:42:583
91191280,11ptp4l401ktimersoftd/321:42:263
91191280,0ptp4l401ktimersoftd/322:31:373
2785199284,14cyclictest5684-21ssh01:04:482
187842280,2sleep20-21swapper/201:18:022
125162280,4sleep212518-21irqrtprio23:19:532
91191270,9ptp4l401ktimersoftd/323:12:283
91191260,1ptp4l401ktimersoftd/322:53:153
91191260,1ptp4l401ktimersoftd/322:40:323
91191260,1ptp4l401ktimersoftd/322:19:433
91191260,1ptp4l401ktimersoftd/322:12:283
91191260,1ptp4l401ktimersoftd/321:46:143
2785199264,19cyclictest9838-21snmpd00:34:522
91191250,1ptp4l401ktimersoftd/322:55:003
91191250,1ptp4l401ktimersoftd/321:55:353
27851992517,5cyclictest21576-21grep23:39:502
2783999252,7cyclictest121rcu_preempt02:27:240
91191240,1ptp4l401ktimersoftd/322:24:463
27851992417,4cyclictest14524-21head02:20:072
27839992414,5cyclictest101ktimersoftd/002:59:510
2785199235,10cyclictest6809-21ssh01:39:502
27851992317,3cyclictest33-21ksoftirqd/223:30:032
27851992315,5cyclictest27626-21grep22:44:482
27839992317,3cyclictest9-21ksoftirqd/001:43:460
27851992217,3cyclictest33-21ksoftirqd/201:22:062
27851992217,3cyclictest311rcuc/200:49:482
27851992216,3cyclictest33-21ksoftirqd/222:44:332
27851992216,3cyclictest33-21ksoftirqd/201:25:412
27851992214,5cyclictest32303-21cut00:24:512
2783999224,10cyclictest31482-21ssh02:39:500
27839992217,3cyclictest9-21ksoftirqd/023:09:460
27839992216,3cyclictest9-21ksoftirqd/022:36:190
27839992216,3cyclictest9-21ksoftirqd/000:05:520
27839992215,4cyclictest9-21ksoftirqd/022:58:510
27839992215,4cyclictest9-21ksoftirqd/021:46:400
27839992215,4cyclictest9-21ksoftirqd/001:35:150
27839992214,5cyclictest10447-21mailstats23:14:560
2783999221,3cyclictest32553-21snmp_o5powerctl23:50:150
289662210,2sleep00-21swapper/002:35:500
2785199213,9cyclictest7982-21ssh23:59:462
2785199213,11cyclictest4355-21ssh00:29:472
2785199212,16cyclictest14472-21sed00:39:522
2785199212,11cyclictest11590-21ssh01:44:482
27851992115,3cyclictest33-21ksoftirqd/222:53:582
27851992115,3cyclictest33-21ksoftirqd/201:34:552
27851992115,3cyclictest22538-21acpi22:34:442
27851992114,4cyclictest3540-21sh02:44:452
27851992114,4cyclictest33-21ksoftirqd/222:16:452
27851992114,4cyclictest31865-21memory02:04:582
27851992114,4cyclictest31235-21sh00:56:532
27851992114,4cyclictest29406-21sh02:02:512
27851992114,4cyclictest22209-21expr03:04:532
27851992114,4cyclictest19144-21sh00:10:022
27851992114,4cyclictest16543-21sh02:58:502
27851992114,4cyclictest16311-21sh00:08:032
27851992114,4cyclictest14868-21cron01:14:362
27851992114,4cyclictest11745-21proc_pri22:09:562
27851992113,4cyclictest3462-21latency_hist02:44:392
27851992112,7cyclictest30532-21cut21:44:322
27839992115,3cyclictest9-21ksoftirqd/023:36:530
27839992115,3cyclictest9-21ksoftirqd/021:49:420
27839992115,3cyclictest9-21ksoftirqd/021:49:420
27839992115,3cyclictest9-21ksoftirqd/003:08:550
27839992115,3cyclictest3691-21ls21:54:450
27839992115,3cyclictest24113-21grep00:15:040
27839992114,4cyclictest9-21ksoftirqd/022:17:150
27839992114,4cyclictest6301-21cut21:59:470
27839992114,4cyclictest6178-21users00:30:060
27839992114,4cyclictest4707-21sed02:10:060
27839992114,4cyclictest15697-21expr22:19:450
27839992113,5cyclictest29823-21cstates01:29:500
2783999210,3cyclictest0-21swapper/002:19:520
2783999210,18cyclictest27120-21tail01:59:570
274472211,4sleep227719-21irqstats02:34:572
2785199206,4cyclictest833-21sshd21:44:052
2785199202,15cyclictest9179-21grep22:04:512
2785199202,11cyclictest3236-21ssh23:54:462
27851992015,3cyclictest33-21ksoftirqd/222:26:532
27851992015,3cyclictest20253-21timerandwakeup23:35:032
27851992014,4cyclictest1294-21sh23:51:472
27851992014,3cyclictest33-21ksoftirqd/223:14:032
27851992014,3cyclictest24841-21sh01:58:152
27851992013,4cyclictest4085-21idleruntime-cro23:04:332
27851992013,4cyclictest31147-21cat01:30:042
27851992013,4cyclictest2673-21grep21:50:002
27851992013,4cyclictest2673-21grep21:50:002
27851992013,4cyclictest23764-21run-parts02:30:012
27851992013,4cyclictest20845-21diskmemload02:51:512
27851992013,4cyclictest20701-21hddtemp_smartct22:29:492
27851992013,4cyclictest16667-21expr01:49:502
27851992012,5cyclictest878-21grep00:59:502
2785199201,16cyclictest18363-21sed02:24:572
2783999208,3cyclictest14483-21tail00:39:520
27839992015,3cyclictest9-21ksoftirqd/022:46:550
27839992015,3cyclictest9-21ksoftirqd/000:00:020
27839992014,3cyclictest26383-21threads22:40:010
27839992014,3cyclictest21516-21sh01:54:510
27839992014,3cyclictest20845-21diskmemload02:15:030
27839992014,3cyclictest20845-21diskmemload02:15:030
27839992014,3cyclictest20141-21/usr/sbin/munin22:29:520
27839992014,3cyclictest14306-21forks23:24:490
27839992014,3cyclictest14306-21forks23:24:490
27839992014,3cyclictest12258-21if_err_enp1s023:19:520
27839992013,4cyclictest8722-21if_enp1s022:04:480
27839992013,4cyclictest6460-21latency_hist23:09:330
27839992013,4cyclictest3176-21bc23:54:450
27839992013,4cyclictest29553-21cat21:39:590
27839992013,4cyclictest27875-21sh00:19:530
27839992013,4cyclictest20845-21diskmemload01:50:320
27839992013,4cyclictest20845-21diskmemload00:39:000
27839992013,4cyclictest17473-21sed23:29:540
27839992013,4cyclictest11089-21basename22:09:520
27839992013,4cyclictest10586-21ls01:09:500
27839992012,5cyclictest30548-21cron23:49:340
27839992012,5cyclictest2189-21sh01:00:010
27839992012,4cyclictest20820-21cut01:19:550
2783999201,16cyclictest30001-21fschecks_count22:49:480
27839992010,7cyclictest32101-21cpuspeed_turbos00:24:490
2783999200,17cyclictest0-21swapper/001:46:010
2785199191,6cyclictest15466-21apt-get22:19:442
27851991913,3cyclictest7832-21/usr/sbin/munin02:14:502
27851991913,3cyclictest7832-21/usr/sbin/munin02:14:502
27851991913,3cyclictest5329-21latency23:04:522
27851991913,3cyclictest20803-21sh03:03:142
27851991912,4cyclictest33-21ksoftirqd/222:02:402
27851991912,4cyclictest18756-21cat00:44:472
27851991912,4cyclictest18756-21cat00:44:472
27851991912,4cyclictest15234-21processes23:24:562
27851991912,4cyclictest15234-21processes23:24:562
27851991912,4cyclictest10585-21awk23:15:022
27839991913,3cyclictest9-21ksoftirqd/023:03:250
27839991913,3cyclictest4199-21idleruntime02:44:570
27839991913,3cyclictest23853-21df_inode00:49:490
27839991913,3cyclictest22328-21/usr/sbin/munin02:29:510
27839991913,3cyclictest20845-21diskmemload23:43:140
27839991913,3cyclictest20845-21diskmemload02:50:010
27839991913,3cyclictest19825-21sh00:10:450
27839991913,3cyclictest18049-21expr22:24:450
27839991913,3cyclictest12743-21/usr/sbin/munin02:54:560
27839991910,5cyclictest15763-21gltestperf01:14:520
2785199181,4cyclictest27443-21df_inode00:19:492
27851991811,4cyclictest33-21ksoftirqd/221:57:142
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional