You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-10-15 - 02:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Tue Oct 15, 2024 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2307825140,0sleep00-21swapper/018:50:000
291350440,0irq/25-eth10-21swapper/318:50:593
2338023425,0sleep20-21swapper/218:53:312
2312623424,0sleep10-21swapper/118:50:341
28405070,0irq/26-eth0-rx-19130-21mdstat21:29:383
235209973,0cyclictest14015-21sadc20:24:212
339960,0migration/3992-21sh23:18:033
339960,0migration/35305-21sh22:24:203
339960,0migration/328421-21sh20:56:163
339960,0migration/325962-21munin-node23:49:393
339960,0migration/319336-21sh23:47:053
339960,0migration/315444-21sh23:05:463
28415060,0irq/27-eth0-tx-23735-21munin-node18:54:330
28415060,0irq/27-eth0-tx-0-21swapper/223:55:442
28405060,0irq/26-eth0-rx-5755-21diskstats22:04:333
28405060,0irq/26-eth0-rx-14081-21df_abs21:09:333
28405060,0irq/26-eth0-rx-13212-21ssh00:23:323
249960,0watchdog/20-21swapper/223:43:032
249960,0watchdog/20-21swapper/222:36:282
249960,0watchdog/20-21swapper/222:17:482
249960,0watchdog/20-21swapper/221:57:562
249960,0watchdog/20-21swapper/221:07:242
249960,0watchdog/20-21swapper/221:01:562
249960,0watchdog/20-21swapper/219:54:442
249960,0watchdog/20-21swapper/200:05:432
249960,0watchdog/20-21swapper/200:05:432
235209962,0cyclictest22698-21awk21:14:352
149960,0migration/03145-21sh23:55:110
149960,0migration/021512-21sh21:14:160
339950,0migration/38278-21taskset20:43:413
339950,0migration/3679-21munin-node20:34:413
339950,0migration/332098-21kthreadcore20:59:383
339950,0migration/328344-21taskset00:10:333
339950,0migration/325451-21kthreadcore22:54:373
339950,0migration/325315-21needreboot20:04:403
339950,0migration/322462-21kthreadcore19:39:383
339950,0migration/320440-21taskset20:26:303
339950,0migration/31954-21aten_r1power_fr23:19:323
339950,0migration/316650-21latency19:09:403
339950,0migration/314139-21munin-node22:09:333
339950,0migration/313199-21latency_hist19:59:213
339950,0migration/313106-21latency_hist19:59:213
339950,0migration/311950-21taskset21:45:383
339950,0migration/311355-21munin-node19:29:433
339950,0migration/310667-21kthreadcore21:04:393
28415050,0irq/27-eth0-tx-8584-21munin-node20:44:350
28415050,0irq/27-eth0-tx-6445-21snmpd19:59:520
28415050,0irq/27-eth0-tx-0-21swapper/223:09:522
28415050,0irq/27-eth0-tx-0-21swapper/020:53:400
28415050,0irq/27-eth0-tx-0-21swapper/020:29:340
28415050,0irq/27-eth0-tx-0-21swapper/019:24:310
28405050,0irq/26-eth0-rx-22536-21if_eth1.321:54:363
28405050,0irq/26-eth0-rx-14152-21ssh22:29:323
28405050,0irq/26-eth0-rx-12284-21ssh22:25:493
28405050,0irq/26-eth0-rx-0-21swapper/323:54:373
28405050,0irq/26-eth0-rx-0-21swapper/323:39:343
28405050,0irq/26-eth0-rx-0-21swapper/323:29:363
28405050,0irq/26-eth0-rx-0-21swapper/323:25:003
28405050,0irq/26-eth0-rx-0-21swapper/323:09:223
28405050,0irq/26-eth0-rx-0-21swapper/322:59:363
28405050,0irq/26-eth0-rx-0-21swapper/322:45:303
28405050,0irq/26-eth0-rx-0-21swapper/322:44:023
28405050,0irq/26-eth0-rx-0-21swapper/322:00:093
28405050,0irq/26-eth0-rx-0-21swapper/321:37:103
28405050,0irq/26-eth0-rx-0-21swapper/321:14:373
28405050,0irq/26-eth0-rx-0-21swapper/300:01:013
249950,0watchdog/20-21swapper/223:53:152
249950,0watchdog/20-21swapper/223:44:512
249950,0watchdog/20-21swapper/223:35:352
249950,0watchdog/20-21swapper/223:29:392
249950,0watchdog/20-21swapper/223:27:472
249950,0watchdog/20-21swapper/223:21:192
249950,0watchdog/20-21swapper/223:15:392
249950,0watchdog/20-21swapper/223:07:232
249950,0watchdog/20-21swapper/223:01:192
249950,0watchdog/20-21swapper/222:55:152
249950,0watchdog/20-21swapper/222:51:512
249950,0watchdog/20-21swapper/222:47:072
249950,0watchdog/20-21swapper/222:31:042
249950,0watchdog/20-21swapper/222:04:522
249950,0watchdog/20-21swapper/222:04:002
249950,0watchdog/20-21swapper/221:44:442
249950,0watchdog/20-21swapper/221:35:442
249950,0watchdog/20-21swapper/221:29:442
249950,0watchdog/20-21swapper/221:27:322
249950,0watchdog/20-21swapper/221:19:402
249950,0watchdog/20-21swapper/220:57:042
249950,0watchdog/20-21swapper/220:49:322
249950,0watchdog/20-21swapper/219:48:322
249950,0watchdog/20-21swapper/219:39:402
249950,0watchdog/20-21swapper/219:24:242
249950,0watchdog/20-21swapper/219:23:202
249950,0watchdog/20-21swapper/219:14:402
249950,0watchdog/20-21swapper/219:04:402
249950,0watchdog/20-21swapper/218:59:402
249950,0watchdog/20-21swapper/200:20:272
249950,0watchdog/20-21swapper/200:17:472
235209955,0cyclictest0-21swapper/221:39:352
235209950,0cyclictest0-21swapper/200:09:312
235199955,0cyclictest0-21swapper/123:17:511
235199955,0cyclictest0-21swapper/122:17:191
235199955,0cyclictest0-21swapper/121:53:501
235199954,0cyclictest20879-21ssh21:12:311
235199954,0cyclictest12265-21kworker/1:223:13:391
235199954,0cyclictest12265-21kworker/1:222:54:451
235199954,0cyclictest12265-21kworker/1:222:38:191
235199954,0cyclictest12265-21kworker/1:222:30:111
235199954,0cyclictest12265-21kworker/1:222:26:531
235199954,0cyclictest12265-21kworker/1:222:20:391
235199954,0cyclictest12265-21kworker/1:221:24:251
235199950,0cyclictest0-21swapper/123:57:261
235199950,0cyclictest0-21swapper/123:48:361
235199950,0cyclictest0-21swapper/123:35:121
235199950,0cyclictest0-21swapper/122:42:041
235199950,0cyclictest0-21swapper/122:07:041
235179955,0cyclictest0-21swapper/000:19:470
235179952,0cyclictest29512-21munin-run21:39:210
235179950,0cyclictest0-21swapper/023:14:030
235179950,0cyclictest0-21swapper/000:06:230
235179950,0cyclictest0-21swapper/000:06:230
179950,0migration/14231-21latency19:24:371
179950,0migration/122875-21munin-node21:14:361
179950,0migration/119511-21kthreadcore19:14:371
179950,0migration/118662-21taskset19:38:221
179950,0migration/115814-21latency23:24:401
179950,0migration/114034-21cpuspeed_turbos21:29:321
179950,0migration/113778-21kthreadcore20:44:401
169950,0watchdog/14151-21kthreadcore19:49:401
149950,0migration/09680-21kthreadcore22:44:390
149950,0migration/0930-21kthreadcore20:59:390
149950,0migration/07346-21dump-pmu-power20:19:160
149950,0migration/03789-21runrttasks21:19:510
149950,0migration/03476-21sh22:19:590
149950,0migration/0341-21cpuspeed_turbos22:59:330
149950,0migration/030018-21df_abs21:59:320
149950,0migration/028828-21taskset23:54:200
149950,0migration/028614-21kthreadcore23:14:390
149950,0migration/028262-21sh22:34:460
149950,0migration/027586-21proc_pri00:09:420
149950,0migration/027530-21timerwakeupswit21:54:430
149950,0migration/024059-21kthreadcore20:54:380
149950,0migration/022974-21kthreadcore19:39:380
149950,0migration/019680-21taskset22:29:420
149950,0migration/018993-21aten_r1power_en23:29:310
149950,0migration/018892-21kthreadcore21:29:380
149950,0migration/016427-21timerwakeupswit23:24:450
149950,0migration/01535-21taskset20:38:290
149950,0migration/015084-21kthreadcore23:44:390
149950,0migration/014267-21aten_r1power_cu20:24:320
149950,0migration/012083-21ntp_offset19:54:410
149950,0migration/011226-21sendmail_mailqu21:44:430
149950,0migration/01027-21kthreadcore00:14:390
339940,0migration/34204-21sh21:41:313
339940,0migration/329441-21diskmemload22:36:453
339940,0migration/328682-21kthreadcore19:44:383
339940,0migration/325083-21kthreadcore20:29:403
28415040,0irq/27-eth0-tx-11444-21telnet19:09:340
28415040,0irq/27-eth0-tx-0-21swapper/020:09:310
28415040,0irq/27-eth0-tx-0-21swapper/019:44:330
28415040,0irq/27-eth0-tx-0-21swapper/019:14:340
28415040,0irq/27-eth0-tx-0-21swapper/019:04:300
28405040,0irq/26-eth0-rx-16639-21kthreadcore21:49:373
28405040,0irq/26-eth0-rx-0-21swapper/323:34:383
28405040,0irq/26-eth0-rx-0-21swapper/322:49:373
28405040,0irq/26-eth0-rx-0-21swapper/322:16:473
28405040,0irq/26-eth0-rx-0-21swapper/321:24:393
28405040,0irq/26-eth0-rx-0-21swapper/321:20:143
28405040,0irq/26-eth0-rx-0-21swapper/320:19:413
28405040,0irq/26-eth0-rx-0-21swapper/319:02:063
28405040,0irq/26-eth0-rx-0-21swapper/300:04:373
28405040,0irq/26-eth0-rx-0-21swapper/300:04:373
249940,0watchdog/20-21swapper/222:43:272
249940,0watchdog/20-21swapper/222:25:562
249940,0watchdog/20-21swapper/222:19:442
249940,0watchdog/20-21swapper/222:09:322
249940,0watchdog/20-21swapper/221:49:562
249940,0watchdog/20-21swapper/221:12:322
249940,0watchdog/20-21swapper/220:40:482
249940,0watchdog/20-21swapper/220:34:322
249940,0watchdog/20-21swapper/220:29:522
249940,0watchdog/20-21swapper/220:14:362
249940,0watchdog/20-21swapper/220:10:322
249940,0watchdog/20-21swapper/220:03:362
249940,0watchdog/20-21swapper/219:50:002
249940,0watchdog/20-21swapper/219:34:242
249940,0watchdog/20-21swapper/219:09:362
249940,0watchdog/20-21swapper/218:56:322
249940,0watchdog/20-21swapper/200:00:192
235209943,0cyclictest6587-21awk19:29:352
235209943,0cyclictest3425-21lldpd20:44:362
235209942,0cyclictest3425-21lldpd20:09:062
235209940,0cyclictest14265-21munin-node20:24:322
235199944,0cyclictest12265-21kworker/1:223:49:431
235199944,0cyclictest12265-21kworker/1:223:39:431
235199944,0cyclictest12265-21kworker/1:223:29:431
235199944,0cyclictest12265-21kworker/1:223:19:251
235199944,0cyclictest12265-21kworker/1:223:00:011
235199944,0cyclictest12265-21kworker/1:222:44:291
235199944,0cyclictest12265-21kworker/1:222:09:371
235199944,0cyclictest12265-21kworker/1:221:59:331
235199944,0cyclictest12265-21kworker/1:221:54:231
235199944,0cyclictest12265-21kworker/1:221:44:291
235199944,0cyclictest12265-21kworker/1:221:39:231
235199944,0cyclictest12265-21kworker/1:221:34:591
235199944,0cyclictest12265-21kworker/1:220:59:331
235199944,0cyclictest12265-21kworker/1:220:54:331
235199944,0cyclictest12265-21kworker/1:220:49:391
235199944,0cyclictest12265-21kworker/1:220:39:411
235199944,0cyclictest12265-21kworker/1:220:36:531
235199944,0cyclictest12265-21kworker/1:220:24:471
235199944,0cyclictest12265-21kworker/1:220:14:371
235199944,0cyclictest12265-21kworker/1:219:59:451
235199944,0cyclictest12265-21kworker/1:219:29:331
235199944,0cyclictest12265-21kworker/1:218:59:311
235199944,0cyclictest12265-21kworker/1:200:14:351
235199944,0cyclictest12265-21kworker/1:200:09:251
235199944,0cyclictest12265-21kworker/1:200:04:471
235199944,0cyclictest12265-21kworker/1:200:04:471
235199943,0cyclictest6550-21awk21:04:371
235199943,0cyclictest6445-21snmpd00:19:551
235199943,0cyclictest3425-21lldpd19:04:361
235199943,0cyclictest26513-21awk19:44:361
235199943,0cyclictest17945-21kthreadcore22:49:381
235199943,0cyclictest12265-21kworker/1:223:59:251
235199943,0cyclictest12265-21kworker/1:223:04:551
235179944,0cyclictest11132-21sensors22:04:420
235179944,0cyclictest0-21swapper/022:24:230
235179944,0cyclictest0-21swapper/022:17:270
235179944,0cyclictest0-21swapper/021:44:200
235179943,0cyclictest704-21awk19:49:370
235179943,0cyclictest6445-21snmpd22:41:390
235179943,0cyclictest6445-21snmpd21:51:090
235179943,0cyclictest6445-21snmpd20:39:240
235179943,0cyclictest6393-21awk21:04:360
235179943,0cyclictest6308-21awk23:59:360
235179943,0cyclictest3110-21irqbalance22:54:350
235179943,0cyclictest2777-21awk23:19:350
179940,0migration/19372-21kthreadcore19:54:391
179940,0migration/132650-21kthreadcore21:19:411
179940,0migration/129185-21munin-node18:54:401
179940,0migration/126563-21runrttasks20:09:251
179940,0migration/120246-21df20:04:341
169940,0watchdog/125277-21cut20:29:401
169940,0watchdog/10-21swapper/120:19:361
169940,0watchdog/10-21swapper/119:09:401
149940,0migration/029483-21kthreadcore23:34:370
28415030,0irq/27-eth0-tx-0-21swapper/020:19:360
28415030,0irq/27-eth0-tx-0-21swapper/020:04:330
28405030,0irq/26-eth0-rx-0-21swapper/320:49:313
28405030,0irq/26-eth0-rx-0-21swapper/320:44:483
28405030,0irq/26-eth0-rx-0-21swapper/320:14:363
28405030,0irq/26-eth0-rx-0-21swapper/320:09:313
28405030,0irq/26-eth0-rx-0-21swapper/319:34:323
28405030,0irq/26-eth0-rx-0-21swapper/319:29:103
28405030,0irq/26-eth0-rx-0-21swapper/319:23:233
28405030,0irq/26-eth0-rx-0-21swapper/319:05:123
28405030,0irq/26-eth0-rx-0-21swapper/318:58:253
28405030,0irq/26-eth0-rx-0-21swapper/300:14:323
235199933,0cyclictest12265-21kworker/1:219:39:331
235199933,0cyclictest12265-21kworker/1:219:19:291
235179933,0cyclictest31341-21awk18:59:350
235179932,0cyclictest6627-21awk21:24:370
235179932,0cyclictest4346-21gltestperf23:39:340
235179932,0cyclictest25562-21awk19:19:360
235179932,0cyclictest22428-21perl21:14:330
235179932,0cyclictest19189-21sensors22:09:410
235179932,0cyclictest12341-21munin-node19:34:340
235179930,0cyclictest15841-21tr22:49:330
28405020,0irq/26-eth0-rx-0-21swapper/319:50:043
28405020,0irq/26-eth0-rx-0-21swapper/319:14:253
235179921,0cyclictest0-21swapper/019:29:320
235179920,0cyclictest0-21swapper/023:04:210
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional