You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-27 - 09:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot2s.osadl.org (updated Sat Jun 27, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
326126059,0sleep10-21swapper/118:51:141
271440,0ktimersoftd/229116-21perf18:51:212
304450350,0irq/25-eth10-21swapper/318:47:113
2932823521,0sleep00-21swapper/018:46:370
3365991212,0cyclictest0-21swapper/020:51:590
33679970,0cyclictest0-21swapper/222:36:442
35160,0ktimersoftd/30-21swapper/319:21:453
33669966,0cyclictest0-21swapper/120:41:461
33669960,0cyclictest0-21swapper/119:11:441
339960,0migration/38803-21sh23:56:103
339960,0migration/38607-21sh22:54:073
339960,0migration/38192-21sh00:14:563
339960,0migration/317751-21sh21:20:163
29715060,0irq/26-eth0-rx-15490-21taskset00:17:493
29715060,0irq/26-eth0-rx-0-21swapper/323:56:493
149960,0migration/030246-21sh19:31:520
33679955,0cyclictest1553-21diskmemload23:47:502
33679955,0cyclictest0-21swapper/221:00:332
33679954,0cyclictest10531-21ps23:56:462
33679950,0cyclictest1553-21diskmemload23:42:282
33679950,0cyclictest0-21swapper/222:04:252
33679950,0cyclictest0-21swapper/200:11:192
33669955,0cyclictest0-21swapper/123:25:251
33669955,0cyclictest0-21swapper/123:17:221
33669955,0cyclictest0-21swapper/123:14:421
33669955,0cyclictest0-21swapper/122:53:531
33669955,0cyclictest0-21swapper/122:26:551
33669955,0cyclictest0-21swapper/122:22:301
33669955,0cyclictest0-21swapper/100:15:141
33669950,0cyclictest0-21swapper/122:02:291
33669950,0cyclictest0-21swapper/121:53:391
33659955,0cyclictest0-21swapper/021:38:510
33659955,0cyclictest0-21swapper/021:26:140
339950,0migration/38043-21fschecks_count20:31:433
339950,0migration/37823-21munin-node20:06:473
339950,0migration/36347-21hwlatdetect19:41:443
339950,0migration/35098-21fschecks_count19:16:443
339950,0migration/34890-21munin-node19:36:553
339950,0migration/33315-21kthreadcore22:31:463
339950,0migration/332487-21taskset21:46:593
339950,0migration/328117-21kthreadcore23:06:493
339950,0migration/326649-21aten_r1power_po20:21:423
339950,0migration/326318-21cpuspeed_turbos22:26:423
339950,0migration/326282-21gltestperf19:56:443
339950,0migration/326282-21cpuspeed_turbos22:46:423
339950,0migration/324463-21diskmemload23:24:073
339950,0migration/324143-21diskmemload22:42:063
339950,0migration/32239-21fschecks_count22:11:433
339950,0migration/320661-21kthreadcore22:01:473
339950,0migration/317997-21latency_hist21:01:313
339950,0migration/317950-21gltestperf00:01:423
339950,0migration/317062-21turbostat.cron23:41:243
339950,0migration/315551-21missed_timers21:56:473
339950,0migration/314234-21irqcore20:11:473
339950,0migration/314204-21kthreadcore19:46:463
29725050,0irq/27-eth0-tx-19340-21kthreadcore00:01:452
29725050,0irq/27-eth0-tx-15531diskmemload23:10:542
29725050,0irq/27-eth0-tx-10859-21diskstats21:16:442
29725050,0irq/27-eth0-tx-10323-21munin-node18:56:440
29725050,0irq/27-eth0-tx-0-21swapper/222:21:462
29715050,0irq/26-eth0-rx-7992-21smartctl21:11:523
29715050,0irq/26-eth0-rx-7253-21sshd20:30:503
29715050,0irq/26-eth0-rx-29046-21tr23:46:483
29715050,0irq/26-eth0-rx-25228-21sh23:05:523
29715050,0irq/26-eth0-rx-20519-21kthreadcore21:21:473
29715050,0irq/26-eth0-rx-19572-21irqstats21:41:463
29715050,0irq/26-eth0-rx-17551-21taskset21:40:153
29715050,0irq/26-eth0-rx-15311-21python23:16:513
29715050,0irq/26-eth0-rx-13511-21kthreadcore20:56:483
29715050,0irq/26-eth0-rx-10602-21if_err_eth1.322:56:443
29715050,0irq/26-eth0-rx-0-21swapper/323:42:473
29715050,0irq/26-eth0-rx-0-21swapper/323:36:123
29715050,0irq/26-eth0-rx-0-21swapper/323:30:553
29715050,0irq/26-eth0-rx-0-21swapper/322:21:343
29715050,0irq/26-eth0-rx-0-21swapper/322:17:043
29715050,0irq/26-eth0-rx-0-21swapper/322:06:353
29715050,0irq/26-eth0-rx-0-21swapper/321:34:253
29715050,0irq/26-eth0-rx-0-21swapper/320:51:443
29715050,0irq/26-eth0-rx-0-21swapper/319:06:563
29715050,0irq/26-eth0-rx-0-21swapper/300:08:203
27150,0ktimersoftd/20-21swapper/222:42:532
259950,0migration/29360-21sh21:14:272
249950,0watchdog/27173-21needreboot22:51:482
249950,0watchdog/223839-21ssh23:22:202
19150,0ktimersoftd/11553-21diskmemload21:26:151
179950,0migration/19836-21aten_r1power_cu22:36:391
179950,0migration/19299-21cpuspeed_turbos00:16:411
179950,0migration/129681-21kthreadcore00:06:491
179950,0migration/125018-21latency_hist00:06:291
179950,0migration/12209-21aten_r1power_fr21:11:411
179950,0migration/121671-21kthreadcore19:01:481
179950,0migration/118748-21idleruntime19:26:451
179950,0migration/116977-21taskset23:41:111
169950,0watchdog/110306-21cpu21:56:411
149950,0migration/08054-21sh22:52:320
149950,0migration/031195-21munin-node19:56:520
149950,0migration/030393-21aten_r1power_po19:11:420
149950,0migration/029668-21kthreadcore23:06:490
149950,0migration/029407-21kthreadcore21:06:490
149950,0migration/019840-21kthreadcore23:01:460
149950,0migration/019454-21kthreadcore19:01:470
149950,0migration/018660-21gltestperf19:26:440
149950,0migration/018186-21kthreadcore20:11:490
149950,0migration/016058-21taskset22:37:020
149950,0migration/015386-21sh23:57:080
149950,0migration/015042-21latency22:56:470
149950,0migration/010349-21fschecks_count22:16:420
8215040,0irq/24-0000:00:18206-21latency_hist21:21:312
8215040,0irq/24-0000:00:0-21swapper/200:11:302
33679944,0cyclictest0-21swapper/223:02:072
33679943,0cyclictest9889-21awk00:16:432
33679943,0cyclictest7484-21awk20:06:462
33679943,0cyclictest3556-21lldpd19:27:282
33679943,0cyclictest3514-21snmpd19:51:002
33679943,0cyclictest3514-21snmpd19:34:592
33679943,0cyclictest3514-21snmpd19:01:592
33679943,0cyclictest3241-21irqbalance21:46:392
33679943,0cyclictest3241-21irqbalance20:52:092
33679943,0cyclictest3241-21irqbalance20:42:092
33679943,0cyclictest3241-21irqbalance20:32:092
33679943,0cyclictest3241-21irqbalance20:26:392
33679943,0cyclictest3241-21irqbalance20:11:592
33679943,0cyclictest3241-21irqbalance19:56:592
33679943,0cyclictest27413-21awk21:26:462
33679943,0cyclictest20789-21awk20:16:462
33669944,0cyclictest0-21swapper/121:16:361
33669944,0cyclictest0-21swapper/121:08:061
33669943,0cyclictest3514-21snmpd23:41:451
33669943,0cyclictest3514-21snmpd22:32:001
33669943,0cyclictest3514-21snmpd20:59:441
33669943,0cyclictest3514-21snmpd19:41:451
33669943,0cyclictest3241-21irqbalance22:56:391
33669943,0cyclictest27254-21awk21:46:451
33669943,0cyclictest26692-21awk23:06:461
33669943,0cyclictest25561-21awk19:31:451
33669943,0cyclictest24458-21awk19:06:471
33669943,0cyclictest1907-21awk23:51:431
33669943,0cyclictest18959-21awk21:01:441
33659944,0cyclictest0-21swapper/000:15:530
33659943,0cyclictest3556-21lldpd22:44:280
33659943,0cyclictest3556-21lldpd22:00:280
33659943,0cyclictest3556-21lldpd00:18:300
33659943,0cyclictest3514-21snmpd23:51:300
33659943,0cyclictest3241-21irqbalance22:21:590
33659943,0cyclictest3241-21irqbalance21:16:590
33659943,0cyclictest3241-21irqbalance21:02:490
33659943,0cyclictest3241-21irqbalance20:56:390
33659943,0cyclictest3241-21irqbalance19:16:390
33659943,0cyclictest27345-21awk21:46:460
33659943,0cyclictest2711-21awk22:11:450
33659943,0cyclictest21749-21awk20:41:450
33659943,0cyclictest19044-21awk22:01:450
33659943,0cyclictest18324-21awk23:41:440
33659943,0cyclictest18086-21awk00:01:430
33659943,0cyclictest1751-21awk20:26:450
33659943,0cyclictest12186-21awk19:21:460
33659943,0cyclictest10427-21awk23:16:430
29725040,0irq/27-eth0-tx-8487-21ssh22:13:152
29725040,0irq/27-eth0-tx-32518-21ssh22:48:032
29725040,0irq/27-eth0-tx-26313-21ssh21:06:322
29725040,0irq/27-eth0-tx-26211-21ssh22:06:412
29725040,0irq/27-eth0-tx-15878-21ssh22:57:032
29725040,0irq/27-eth0-tx-0-21swapper/223:51:462
29725040,0irq/27-eth0-tx-0-21swapper/223:26:542
29725040,0irq/27-eth0-tx-0-21swapper/222:32:372
29725040,0irq/27-eth0-tx-0-21swapper/222:27:492
29725040,0irq/27-eth0-tx-0-21swapper/221:56:442
29725040,0irq/27-eth0-tx-0-21swapper/221:51:432
29725040,0irq/27-eth0-tx-0-21swapper/221:41:362
29725040,0irq/27-eth0-tx-0-21swapper/019:36:440
29715040,0irq/26-eth0-rx-0-21swapper/323:12:023
29715040,0irq/26-eth0-rx-0-21swapper/322:37:163
29715040,0irq/26-eth0-rx-0-21swapper/321:51:483
29715040,0irq/26-eth0-rx-0-21swapper/321:26:433
29715040,0irq/26-eth0-rx-0-21swapper/321:09:223
29715040,0irq/26-eth0-rx-0-21swapper/320:36:473
29715040,0irq/26-eth0-rx-0-21swapper/320:16:423
29715040,0irq/26-eth0-rx-0-21swapper/320:01:463
29715040,0irq/26-eth0-rx-0-21swapper/318:56:423
259940,0migration/28073-21kthreadcore18:51:482
259940,0migration/25412-21latency_hist19:41:312
259940,0migration/23932-21kthreadcore23:31:462
259940,0migration/226936-21munin-node20:21:432
259940,0migration/22155-21aten_r1power_cu21:31:402
259940,0migration/220085-21irqrtprio19:51:462
259940,0migration/220066-21kthreadcore21:01:462
259940,0migration/217440-21runrttasks19:23:382
259940,0migration/21626-21cpuspeed_turbos23:11:412
259940,0migration/215013-21kthreadcore18:56:482
259940,0migration/214625-21taskset20:36:432
259940,0migration/21149-21kthreadcore20:01:462
259940,0migration/210438-21fschecks_count22:16:422
249940,0watchdog/26468-21if_eth119:41:452
249940,0watchdog/214858-21nfs4_client23:36:482
249940,0watchdog/212772-21kthreadcore21:36:492
249940,0watchdog/20-21swapper/223:17:282
249940,0watchdog/20-21swapper/220:46:492
249940,0watchdog/20-21swapper/219:06:492
179940,0migration/1784-21kthreadcore19:36:491
179940,0migration/1655-21runrttasks22:09:111
179940,0migration/16156-21kthreadcore18:51:471
179940,0migration/15092-21kthreadcore23:31:471
179940,0migration/132484-21timerwakeupswit21:26:541
179940,0migration/128881-21kthreadcore22:46:471
179940,0migration/128237-21kthreadcore19:56:481
179940,0migration/126639-21aten_r1power_po20:21:421
179940,0migration/123442-21kthreadcore20:16:481
179940,0migration/119967-21kthreadcore21:41:471
179940,0migration/117390-21kthreadcore20:36:481
179940,0migration/115484-21kthreadcore18:56:491
179940,0migration/114209-21munin-node20:11:471
179940,0migration/113711-21kthreadcore19:46:461
179940,0migration/113677-21kthreadcore19:21:481
179940,0migration/110615-21gltestperf22:16:431
169940,0watchdog/122070-21kthreadcore22:41:481
169940,0watchdog/117835-21aten_r1power_po23:01:401
169940,0watchdog/114499-21latency23:56:481
169940,0watchdog/113016-21munin-node20:31:491
169940,0watchdog/11200-21chrt20:47:371
169940,0watchdog/10-21swapper/123:49:361
169940,0watchdog/10-21swapper/121:36:491
149940,0migration/09708-21sh21:35:460
149940,0migration/08961-21kthreadcore20:31:460
149940,0migration/07268-21gltestperf20:06:450
149940,0migration/06268-21taskset20:06:190
149940,0migration/05816-21kthreadcore22:31:470
149940,0migration/031986-21nfs_client20:21:500
149940,0migration/031814-21munin-node22:26:520
149940,0migration/031216-21timerwakeupswit00:06:540
149940,0migration/029469-21kthreadcore23:46:480
149940,0migration/027812-21kthreadcore22:46:470
149940,0migration/027530-21iostat21:26:470
149940,0migration/026218-21aten_r1power_cu22:06:410
149940,0migration/025540-21kthreadcore19:06:490
149940,0migration/024991-21taskset19:52:420
149940,0migration/01846-21fschecks_count23:11:420
149940,0migration/018438-21taskset19:48:540
149940,0migration/018092-21kthreadcore20:36:480
33679932,0cyclictest3556-21lldpd19:19:282
33669933,0cyclictest0-21swapper/122:13:411
33669933,0cyclictest0-21swapper/120:28:411
33669932,0cyclictest3556-21lldpd19:51:581
33659932,0cyclictest3556-21lldpd21:11:580
33659932,0cyclictest3556-21lldpd18:51:580
33659932,0cyclictest26496-21awk23:26:430
33659932,0cyclictest20759-21awk20:16:450
33659932,0cyclictest19164-21awk21:41:450
33659932,0cyclictest18412-21awk23:21:420
33659932,0cyclictest11238-21sensors19:41:520
33659930,0cyclictest29370-21kthreadcore20:46:470
33659930,0cyclictest2368-21diskstats21:51:430
33659930,0cyclictest1805-21perl23:31:430
33659930,0cyclictest14732-21memory23:36:480
29715030,0irq/26-eth0-rx-0-21swapper/320:41:533
29715030,0irq/26-eth0-rx-0-21swapper/319:55:503
29715030,0irq/26-eth0-rx-0-21swapper/319:31:423
29715030,0irq/26-eth0-rx-0-21swapper/319:30:373
29715030,0irq/26-eth0-rx-0-21swapper/319:11:423
29715030,0irq/26-eth0-rx-0-21swapper/319:02:303
29715030,0irq/26-eth0-rx-0-21swapper/318:51:413
169930,0watchdog/10-21swapper/123:26:321
169930,0watchdog/10-21swapper/121:32:051
169930,0watchdog/10-21swapper/120:53:291
169930,0watchdog/10-21swapper/120:06:451
169930,0watchdog/10-21swapper/120:01:451
33669921,0cyclictest4592-21aten_r1power_cu19:16:421
29715020,0irq/26-eth0-rx-0-21swapper/320:46:363
249920,0watchdog/20-21swapper/219:11:332
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional