You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-05 - 22:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Fri Jun 05, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
950823727,0sleep30-21swapper/306:52:053
941023524,0sleep00-21swapper/006:50:580
940723526,0sleep20-21swapper/206:50:562
932523324,0sleep10-21swapper/106:49:591
97039960,0cyclictest29497-21kthreadcore09:43:512
97029960,0cyclictest0-21swapper/112:18:451
97009960,0cyclictest0-21swapper/011:38:510
35160,0ktimersoftd/30-21swapper/310:58:183
339960,0migration/38143-21sh09:52:473
339960,0migration/38043-21munin-node11:53:453
339960,0migration/37369-21sh09:30:053
339960,0migration/36627-21sh10:09:063
339960,0migration/35781-21sh11:49:503
339960,0migration/332375-21munin-node12:08:473
339960,0migration/332014-21aten_r1power_vo11:28:443
339960,0migration/331994-21sh09:07:123
339960,0migration/331074-21sh10:25:013
339960,0migration/330812-21sh11:26:233
339960,0migration/323220-21sh09:00:513
339960,0migration/316699-21sh09:58:403
339960,0migration/315683-21sh10:37:363
339960,0migration/315637-21sh09:56:143
259960,0migration/27826-21sh10:12:322
149960,0migration/023178-21sh11:01:420
149960,0migration/015350-21sh11:17:510
149960,0migration/014494-21sh10:54:430
97039955,0cyclictest7963-21diskmemload09:01:072
97039955,0cyclictest0-21swapper/212:05:072
97039955,0cyclictest0-21swapper/211:32:382
97039955,0cyclictest0-21swapper/211:13:142
97039955,0cyclictest0-21swapper/208:53:432
97039954,0cyclictest14756-21awk08:33:482
97039950,0cyclictest0-21swapper/211:26:102
97039950,0cyclictest0-21swapper/211:19:422
97039950,0cyclictest0-21swapper/210:17:542
97039950,0cyclictest0-21swapper/209:09:292
97029954,0cyclictest14215-21ssh10:13:531
97029950,0cyclictest0-21swapper/111:03:241
97029950,0cyclictest0-21swapper/109:20:171
97029950,0cyclictest0-21swapper/109:03:341
97009955,0cyclictest0-21swapper/011:09:220
97009955,0cyclictest0-21swapper/010:38:570
97009950,0cyclictest0-21swapper/012:18:160
97009950,0cyclictest0-21swapper/012:18:160
97009950,0cyclictest0-21swapper/009:14:080
97009950,0cyclictest0-21swapper/008:59:560
339950,0migration/38108-21kthreadcore07:38:513
339950,0migration/38087-21cpuspeed_turbos11:13:473
339950,0migration/36834-21taskset08:26:593
339950,0migration/36823-21mdstat08:48:513
339950,0migration/332684-21munin-node08:43:523
339950,0migration/328430-21kthreadcore09:43:513
339950,0migration/326757-21kthreadcore07:03:513
339950,0migration/326660-21kthreadcore11:43:483
339950,0migration/326153-21sendmail_mailqu08:38:543
339950,0migration/325976-21irqrtprio10:03:493
339950,0migration/324576-21fschecks_count11:03:463
339950,0migration/321741-21kthreadcore06:58:523
339950,0migration/319631-21timerandwakeup08:33:563
339950,0migration/319024-21kthreadcore07:23:513
339950,0migration/318660-21aten_r1power_po07:48:463
339950,0migration/317335-21idleruntime10:18:483
339950,0migration/316943-21taskset07:19:233
339950,0migration/316243-21munin-node11:58:453
339950,0migration/316037-21runrttasks09:16:403
339950,0migration/315767-21timerwakeupswit06:53:573
339950,0migration/313085-21munin-node11:33:513
339950,0migration/310259-21taskset07:13:593
29725050,0irq/27-eth0-tx-31868-21munin-node07:58:490
29725050,0irq/27-eth0-tx-21439-21unixbench_singl11:58:542
29725050,0irq/27-eth0-tx-15025-21ssh10:56:162
29725050,0irq/27-eth0-tx-0-21swapper/211:53:542
29725050,0irq/27-eth0-tx-0-21swapper/211:39:452
29725050,0irq/27-eth0-tx-0-21swapper/210:53:182
29725050,0irq/27-eth0-tx-0-21swapper/210:29:172
29725050,0irq/27-eth0-tx-0-21swapper/210:05:432
29725050,0irq/27-eth0-tx-0-21swapper/008:43:510
29725050,0irq/27-eth0-tx-0-21swapper/008:05:330
29725050,0irq/27-eth0-tx-0-21swapper/007:43:440
29715050,0irq/26-eth0-rx-5672-21ssh11:08:553
29715050,0irq/26-eth0-rx-4160-21kthreadcore09:08:513
29715050,0irq/26-eth0-rx-31648-21hwlatdetect07:33:503
29715050,0irq/26-eth0-rx-25348-21cpu09:23:453
29715050,0irq/26-eth0-rx-24377-21if_eth1.312:03:473
29715050,0irq/26-eth0-rx-19369-21kthreadcore09:38:503
29715050,0irq/26-eth0-rx-16959-21ssh09:18:363
29715050,0irq/26-eth0-rx-15861-21munin-node11:38:443
29715050,0irq/26-eth0-rx-15368-21hostname12:18:443
29715050,0irq/26-eth0-rx-0-21swapper/311:19:143
29715050,0irq/26-eth0-rx-0-21swapper/310:38:573
29715050,0irq/26-eth0-rx-0-21swapper/310:13:493
29715050,0irq/26-eth0-rx-0-21swapper/309:33:483
259950,0migration/26186-21latency09:28:512
259950,0migration/230517-21munin-node10:23:552
259950,0migration/223738-21sh09:20:262
259950,0migration/216703-21munin-node07:18:592
259950,0migration/216063-21sh10:58:382
259950,0migration/213514-21timerandwakeup11:33:552
259950,0migration/211259-21kthreadcore08:03:522
169950,0watchdog/129316-21kthreadcore08:18:521
169950,0watchdog/10-21swapper/107:03:561
149950,0migration/09898-21latency_hist06:53:340
149950,0migration/07020-21taskset09:29:030
149950,0migration/05687-21kthreadcore07:13:500
149950,0migration/04229-21kthreadcore09:48:510
149950,0migration/04145-21kthreadcore10:48:520
149950,0migration/032212-21sh10:07:420
149950,0migration/031030-21sh11:47:280
149950,0migration/030547-21taskset07:32:540
149950,0migration/022722-21munin-node09:38:560
149950,0migration/021987-21kthreadcore08:13:510
149950,0migration/01966-21kthreadcore11:48:490
149950,0migration/019431-21kthreadcore11:18:510
149950,0migration/018374-21kthreadcore06:58:510
149950,0migration/016710-21ksmtuned09:58:410
149950,0migration/016542-21munin-node07:18:580
149950,0migration/015415-21sh12:18:450
149950,0migration/015280-21kthreadcore08:33:500
149950,0migration/014743-21kthreadcore08:08:510
149950,0migration/013566-21kthreadcore10:13:500
97039944,0cyclictest0-21swapper/206:59:062
97039943,0cyclictest3514-21snmpd10:33:462
97039943,0cyclictest30740-21awk07:08:502
97029944,0cyclictest0-21swapper/111:10:581
97029944,0cyclictest0-21swapper/109:10:501
97029943,0cyclictest9159-21awk10:33:481
97029943,0cyclictest8850-21awk11:13:501
97029943,0cyclictest8298-21awk11:53:471
97029943,0cyclictest8195-21awk08:28:501
97029943,0cyclictest3556-21lldpd11:52:131
97029943,0cyclictest3556-21lldpd11:44:131
97029943,0cyclictest3556-21lldpd11:34:431
97029943,0cyclictest3556-21lldpd11:18:421
97029943,0cyclictest3556-21lldpd10:25:421
97029943,0cyclictest3556-21lldpd08:33:421
97029943,0cyclictest3556-21lldpd08:09:421
97029943,0cyclictest3556-21lldpd08:06:121
97029943,0cyclictest3556-21lldpd07:24:411
97029943,0cyclictest3556-21lldpd07:18:411
97029943,0cyclictest3514-21snmpd12:04:011
97029943,0cyclictest3514-21snmpd08:24:451
97029943,0cyclictest3241-21irqbalance09:34:521
97029943,0cyclictest32359-21awk12:08:471
97029943,0cyclictest31806-21awk07:33:511
97029943,0cyclictest25905-21awk09:43:481
97029943,0cyclictest24284-21egrep11:03:441
97029943,0cyclictest17648-21awk09:58:471
97029943,0cyclictest17466-21awk10:18:491
97029943,0cyclictest16587-21awk11:38:471
97029943,0cyclictest10805-21awk06:53:491
97009944,0cyclictest0-21swapper/011:36:200
97009944,0cyclictest0-21swapper/009:53:510
97009944,0cyclictest0-21swapper/009:20:170
97009944,0cyclictest0-21swapper/009:07:590
97009943,0cyclictest8120-21tail11:53:450
97009943,0cyclictest3514-21snmpd11:24:010
97009943,0cyclictest346-21awk11:28:480
97009943,0cyclictest30725-21awk07:08:490
97009943,0cyclictest26023-21awk09:23:480
97009943,0cyclictest25880-21awk09:43:480
97009943,0cyclictest25175-21awk10:43:480
97009943,0cyclictest16314-21awk11:58:460
97009943,0cyclictest0-21swapper/008:41:160
339940,0migration/324575-21cpuspeed_turbos10:43:453
339940,0migration/32330-21kthreadcore10:28:503
339940,0migration/315245-21kthreadcore08:08:513
339940,0migration/314385-21sh08:54:053
29725040,0irq/27-eth0-tx-6559-21runrttasks10:44:162
29725040,0irq/27-eth0-tx-24052-21ssh11:03:342
29725040,0irq/27-eth0-tx-15245-21munin-node12:18:492
29725040,0irq/27-eth0-tx-0-21swapper/211:49:342
29725040,0irq/27-eth0-tx-0-21swapper/211:43:342
29725040,0irq/27-eth0-tx-0-21swapper/210:40:072
29725040,0irq/27-eth0-tx-0-21swapper/210:18:372
29725040,0irq/27-eth0-tx-0-21swapper/209:53:392
29725040,0irq/27-eth0-tx-0-21swapper/209:33:492
29725040,0irq/27-eth0-tx-0-21swapper/209:24:002
29725040,0irq/27-eth0-tx-0-21swapper/209:03:382
29715040,0irq/26-eth0-rx-0-21swapper/312:13:433
29715040,0irq/26-eth0-rx-0-21swapper/312:13:433
29715040,0irq/26-eth0-rx-0-21swapper/310:58:453
29715040,0irq/26-eth0-rx-0-21swapper/310:48:513
29715040,0irq/26-eth0-rx-0-21swapper/308:28:493
259940,0migration/29873-21kthreadcore12:13:492
259940,0migration/29873-21kthreadcore12:13:492
259940,0migration/29706-21kthreadcore11:13:512
259940,0migration/28808-21aten_r1power_en09:13:432
259940,0migration/28491-21kernelversion08:28:502
259940,0migration/2559-21aten_r1power_cu09:48:452
259940,0migration/23403-21kthreadcore12:08:502
259940,0migration/218372-21kthreadcore09:58:492
259940,0migration/21837-21kthreadcore07:58:512
259940,0migration/21327-21latency_hist08:48:342
249940,0watchdog/229315-21kthreadcore08:18:522
249940,0watchdog/226782-21kthreadcore07:28:522
249940,0watchdog/220385-21if_eth008:13:482
249940,0watchdog/20-21swapper/209:38:562
249940,0watchdog/20-21swapper/208:08:482
249940,0watchdog/20-21swapper/207:38:522
249940,0watchdog/20-21swapper/207:03:562
179940,0migration/17950-21hddtemp_smartct12:13:461
179940,0migration/17950-21hddtemp_smartct12:13:461
179940,0migration/17501-21kthreadcore07:13:501
179940,0migration/16311-21kthreadcore08:48:511
179940,0migration/16207-21smart_sdb10:08:551
179940,0migration/1385-21latency_hist09:48:341
179940,0migration/132739-21munin-node07:58:491
179940,0migration/130672-21sh11:25:571
179940,0migration/130260-21df_abs07:08:471
179940,0migration/128692-21kthreadcore10:43:511
179940,0migration/12776-21kthreadcore11:28:501
179940,0migration/125188-21ksmtuned07:53:401
179940,0migration/124971-21munin-node08:13:531
179940,0migration/11912-21kthreadcore10:28:491
179940,0migration/117140-21idleruntime10:38:481
179940,0migration/116569-21latency_hist06:58:341
179940,0migration/116471-21munin-node11:58:471
179940,0migration/111683-21kthreadcore08:53:491
169940,0watchdog/13901-21cut10:48:521
169940,0watchdog/124595-21diskstats07:28:481
169940,0watchdog/122838-21timerandwakeup09:38:561
169940,0watchdog/119316-21smartctl07:48:481
169940,0watchdog/110322-21grep09:13:481
169940,0watchdog/110021-21kthreadcore09:53:481
169940,0watchdog/10-21swapper/110:03:401
149940,0migration/07242-21sh10:31:230
149940,0migration/05772-21fschecks_time07:38:470
149940,0migration/03740-21kthreadcore08:48:500
149940,0migration/027441-21kthreadcore12:03:490
149940,0migration/02147-21kthreadcore08:23:510
149940,0migration/014483-21sh08:54:220
149940,0migration/010018-21kthreadcore08:28:510
97039932,0cyclictest5156-21awk07:13:482
97039932,0cyclictest3556-21lldpd08:40:422
97039932,0cyclictest3556-21lldpd07:23:412
97039932,0cyclictest32523-21tail08:43:502
97039932,0cyclictest12811-21awk07:43:482
97029932,0cyclictest8930-21awk10:53:471
97029932,0cyclictest6116-21awk07:38:491
97029932,0cyclictest3556-21lldpd09:28:411
97029932,0cyclictest3556-21lldpd08:59:121
97029932,0cyclictest20524-21munin-node08:38:451
97009933,0cyclictest4011-21kworker/0:212:08:340
97009933,0cyclictest4011-21kworker/0:211:03:370
97009933,0cyclictest4011-21kworker/0:210:33:390
97009933,0cyclictest4011-21kworker/0:210:23:350
97009933,0cyclictest4011-21kworker/0:210:18:350
97009933,0cyclictest4011-21kworker/0:210:08:450
97009933,0cyclictest4011-21kworker/0:209:33:350
97009933,0cyclictest4011-21kworker/0:209:08:390
97009933,0cyclictest4011-21kworker/0:207:48:350
97009933,0cyclictest4011-21kworker/0:207:33:500
97009933,0cyclictest4011-21kworker/0:207:23:540
97009933,0cyclictest4011-21kworker/0:207:03:380
97009932,0cyclictest26126-21awk07:53:480
97009930,0cyclictest0-21swapper/008:18:470
29715030,0irq/26-eth0-rx-0-21swapper/308:20:523
29715030,0irq/26-eth0-rx-0-21swapper/308:13:533
29715030,0irq/26-eth0-rx-0-21swapper/308:03:463
29715030,0irq/26-eth0-rx-0-21swapper/307:58:443
29715030,0irq/26-eth0-rx-0-21swapper/307:53:443
29715030,0irq/26-eth0-rx-0-21swapper/307:43:453
29715030,0irq/26-eth0-rx-0-21swapper/307:28:463
29715030,0irq/26-eth0-rx-0-21swapper/307:08:463
249930,0watchdog/20-21swapper/207:53:522
249930,0watchdog/20-21swapper/207:48:482
249930,0watchdog/20-21swapper/207:33:522
249930,0watchdog/20-21swapper/206:53:532
179930,0migration/130572-21missed_timers09:23:511
169930,0watchdog/128687-21kthreadcore08:43:481
97029921,0cyclictest11801-21date07:43:341
249920,0watchdog/20-21swapper/208:23:362
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional