You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-19 - 09:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Wed Aug 19, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450970,0irq/25-eth10-21swapper/318:45:423
504823726,0sleep00-21swapper/018:42:300
528923425,0sleep10-21swapper/118:45:201
504523324,0sleep20-21swapper/218:42:282
54569966,0cyclictest0-21swapper/222:36:492
339960,0migration/36308-21sh23:29:163
339960,0migration/324764-21sh21:57:593
339960,0migration/313276-21sh23:52:543
29715060,0irq/26-eth0-rx-29463-21cut22:21:453
29715060,0irq/26-eth0-rx-24219-21diskstats23:21:403
29715060,0irq/26-eth0-rx-15043-21df23:56:383
149960,0migration/08809-21kthreadcore23:31:430
149960,0migration/032492-21sh22:46:080
149960,0migration/022366-21kthreadcore19:46:460
149960,0migration/011942-21sh21:11:420
8215050,0irq/24-0000:00:32615-21basename22:46:272
8215050,0irq/24-0000:00:28475-21python00:01:492
8215050,0irq/24-0000:00:14964-21cat20:06:222
54569955,0cyclictest0-21swapper/223:29:092
54569955,0cyclictest0-21swapper/223:11:012
54569955,0cyclictest0-21swapper/223:11:012
54569950,0cyclictest0-21swapper/221:58:022
54569950,0cyclictest0-21swapper/221:28:142
54559955,0cyclictest3514-21snmpd19:01:031
54559955,0cyclictest0-21swapper/122:40:031
54559955,0cyclictest0-21swapper/121:37:461
54559950,0cyclictest0-21swapper/122:32:001
54559950,0cyclictest0-21swapper/122:14:121
54559950,0cyclictest0-21swapper/120:57:251
54559950,0cyclictest0-21swapper/120:16:541
54559950,0cyclictest0-21swapper/119:51:311
54559950,0cyclictest0-21swapper/100:11:481
54549950,0cyclictest0-21swapper/021:58:030
54549950,0cyclictest0-21swapper/021:18:190
339950,0migration/39432-21latency_hist20:26:273
339950,0migration/3862-21kthreadcore00:06:433
339950,0migration/37807-21munin-node19:56:513
339950,0migration/36235-21kthreadcore20:21:443
339950,0migration/32752-21latency_hist21:26:273
339950,0migration/327221-21latency_hist21:21:273
339950,0migration/326597-21kthreadcore22:41:433
339950,0migration/326417-21hwlatdetect19:01:393
339950,0migration/321321-21kthreadcore18:56:453
339950,0migration/317546-21taskset21:33:243
339950,0migration/315466-21smart_sda22:11:503
339950,0migration/312306-21runrttasks00:11:493
339950,0migration/31066-21unixbench_multi19:51:523
29725050,0irq/27-eth0-tx-9689-21munin-node22:11:402
29725050,0irq/27-eth0-tx-7928-21ntp_offset21:46:482
29725050,0irq/27-eth0-tx-7337-21munin-node23:31:472
29725050,0irq/27-eth0-tx-32274-21munin-node19:06:410
29725050,0irq/27-eth0-tx-24036-21idleruntime23:41:452
29725050,0irq/27-eth0-tx-19834-21munin-node20:56:492
29725050,0irq/27-eth0-tx-14314-21ssh23:12:362
29725050,0irq/27-eth0-tx-12337-21munin-node18:51:430
29725050,0irq/27-eth0-tx-11798-21ssh20:51:362
29725050,0irq/27-eth0-tx-0-21swapper/223:38:392
29725050,0irq/27-eth0-tx-0-21swapper/222:55:382
29725050,0irq/27-eth0-tx-0-21swapper/222:20:532
29725050,0irq/27-eth0-tx-0-21swapper/222:09:542
29725050,0irq/27-eth0-tx-0-21swapper/221:36:452
29725050,0irq/27-eth0-tx-0-21swapper/221:06:422
29725050,0irq/27-eth0-tx-0-21swapper/020:46:470
29725050,0irq/27-eth0-tx-0-21swapper/020:36:390
29725050,0irq/27-eth0-tx-0-21swapper/019:46:120
29725050,0irq/27-eth0-tx-0-21swapper/019:31:410
29725050,0irq/27-eth0-tx-0-21swapper/019:11:470
29725050,0irq/27-eth0-tx-0-21swapper/019:01:450
29715050,0irq/26-eth0-rx-819-21ssh22:04:513
29715050,0irq/26-eth0-rx-5647-21kthreadcore22:46:463
29715050,0irq/26-eth0-rx-31045-21ssh23:03:283
29715050,0irq/26-eth0-rx-28202-21cut23:41:493
29715050,0irq/26-eth0-rx-25201-21sh22:21:193
29715050,0irq/26-eth0-rx-18173-21sed18:51:513
29715050,0irq/26-eth0-rx-17584-21swap20:51:493
29715050,0irq/26-eth0-rx-15909-21tune2fs23:36:413
29715050,0irq/26-eth0-rx-13146-21kthreadcore21:11:453
29715050,0irq/26-eth0-rx-0-21swapper/323:47:523
29715050,0irq/26-eth0-rx-0-21swapper/323:10:073
29715050,0irq/26-eth0-rx-0-21swapper/323:10:073
29715050,0irq/26-eth0-rx-0-21swapper/322:56:413
29715050,0irq/26-eth0-rx-0-21swapper/322:40:463
29715050,0irq/26-eth0-rx-0-21swapper/322:32:393
29715050,0irq/26-eth0-rx-0-21swapper/322:26:453
29715050,0irq/26-eth0-rx-0-21swapper/322:11:203
29715050,0irq/26-eth0-rx-0-21swapper/321:52:083
29715050,0irq/26-eth0-rx-0-21swapper/321:07:113
29715050,0irq/26-eth0-rx-0-21swapper/321:02:433
29715050,0irq/26-eth0-rx-0-21swapper/320:56:593
259950,0migration/29920-21kthreadcore18:46:462
259950,0migration/27568-21kernelversion00:11:422
259950,0migration/227101-21kthreadcore23:21:452
259950,0migration/223877-21kthreadcore21:16:442
259950,0migration/220988-21aten_r1power_en19:46:402
259950,0migration/219873-21if_eth018:56:432
259950,0migration/218937-21kthreadcore23:16:432
259950,0migration/21130-21munin-node21:01:492
249950,0watchdog/227706-21df21:21:412
249950,0watchdog/213187-21ssh23:52:372
249950,0watchdog/212848-21kthreadcore21:11:452
19150,0ktimersoftd/10-21swapper/122:06:231
179950,0migration/16957-21taskset23:31:101
179950,0migration/131114-21pmu-power19:01:451
179950,0migration/129688-21timerandwakeup23:21:511
179950,0migration/128568-21latency23:41:491
179950,0migration/114212-21sh23:55:481
179950,0migration/110985-21kthreadcore19:11:461
179950,0migration/110179-21latency_hist21:51:271
169950,0watchdog/119950-21grep21:56:451
149950,0migration/09266-21cpu22:31:380
149950,0migration/08459-21unixbench_singl21:46:510
149950,0migration/0603-21latency_hist19:31:270
149950,0migration/05199-21kthreadcore22:06:440
149950,0migration/04844-21taskset00:08:090
149950,0migration/0484-21irqrtprio23:26:430
149950,0migration/027957-21fschecks_time21:21:420
149950,0migration/027551-21latency_hist19:51:270
149950,0migration/026167-21kthreadcore23:21:450
149950,0migration/024350-21kthreadcore20:11:450
149950,0migration/020698-21kthreadcore23:16:440
149950,0migration/020035-21kthreadcore22:36:460
149950,0migration/018925-21latency_hist18:56:270
149950,0migration/018296-21kthreadcore23:36:450
149950,0migration/016575-21munin-node21:31:490
149950,0migration/014179-21munin-node20:01:480
149950,0migration/012791-21sh00:13:060
149950,0migration/011055-21kthreadcore19:36:460
54569943,0cyclictest4745-21awk20:46:432
54569943,0cyclictest3556-21lldpd22:01:312
54569943,0cyclictest3556-21lldpd20:09:012
54569943,0cyclictest3241-21irqbalance23:46:352
54569943,0cyclictest3241-21irqbalance21:41:552
54569943,0cyclictest29390-21awk20:16:432
54569943,0cyclictest23648-21awk20:36:432
54569943,0cyclictest20799-21awk19:21:442
54569943,0cyclictest20697-21sadc19:46:272
54569943,0cyclictest17383-21awk22:56:402
54569943,0cyclictest11862-21awk21:31:432
54569940,0cyclictest0-21swapper/220:32:542
54559944,0cyclictest0-21swapper/121:28:191
54559944,0cyclictest0-21swapper/121:06:331
54559944,0cyclictest0-21swapper/121:01:591
54559944,0cyclictest0-21swapper/120:11:321
54559943,0cyclictest3556-21lldpd23:41:021
54559943,0cyclictest3556-21lldpd22:41:321
54559943,0cyclictest3556-21lldpd22:25:011
54559943,0cyclictest3556-21lldpd22:09:311
54559943,0cyclictest3556-21lldpd21:16:311
54559943,0cyclictest3556-21lldpd00:11:021
54559943,0cyclictest23799-21ps20:36:441
54559943,0cyclictest15273-21ps19:41:491
54549944,0cyclictest0-21swapper/023:10:530
54549944,0cyclictest0-21swapper/023:10:530
54549944,0cyclictest0-21swapper/021:07:450
54549943,0cyclictest7765-21awk23:51:430
54549943,0cyclictest3514-21snmpd21:54:530
54549943,0cyclictest3514-21snmpd20:25:080
54549943,0cyclictest3514-21snmpd00:02:540
54549943,0cyclictest3241-21irqbalance22:28:350
54549943,0cyclictest28719-21awk21:01:430
54549943,0cyclictest20684-21kworker/0:022:46:420
54549943,0cyclictest17285-21awk22:56:390
54549943,0cyclictest17105-21awk20:31:440
54549943,0cyclictest15599-21awk23:56:400
54549942,0cyclictest20684-21kworker/0:022:11:460
339940,0migration/39655-21kthreadcore18:46:463
339940,0migration/34702-21kthreadcore21:46:453
339940,0migration/34433-21kthreadcore19:31:463
339940,0migration/321613-21taskset20:11:213
339940,0migration/321162-21kthreadcore21:36:453
339940,0migration/317639-21kthreadcore19:16:473
339940,0migration/311537-21kthreadcore22:51:443
339940,0migration/31048-21kthreadcore20:16:463
29725040,0irq/27-eth0-tx-3514-21snmpd22:26:412
29725040,0irq/27-eth0-tx-0-21swapper/223:56:562
29725040,0irq/27-eth0-tx-0-21swapper/223:01:392
29725040,0irq/27-eth0-tx-0-21swapper/222:46:412
29725040,0irq/27-eth0-tx-0-21swapper/222:32:242
29725040,0irq/27-eth0-tx-0-21swapper/221:52:592
29725040,0irq/27-eth0-tx-0-21swapper/200:06:282
29725040,0irq/27-eth0-tx-0-21swapper/019:16:420
29715040,0irq/26-eth0-rx-31746-21kthreadcore21:41:463
29715040,0irq/26-eth0-rx-14065-21vmstat23:11:513
29715040,0irq/26-eth0-rx-0-21swapper/323:31:413
29715040,0irq/26-eth0-rx-0-21swapper/323:16:303
29715040,0irq/26-eth0-rx-0-21swapper/321:21:443
29715040,0irq/26-eth0-rx-0-21swapper/320:46:393
29715040,0irq/26-eth0-rx-0-21swapper/320:11:403
29715040,0irq/26-eth0-rx-0-21swapper/320:03:163
29715040,0irq/26-eth0-rx-0-21swapper/300:01:363
259940,0migration/2726-21kthreadcore20:41:452
259940,0migration/23546-21kthreadcore19:56:442
259940,0migration/229344-21kthreadcore19:51:462
259940,0migration/226905-21irqrtprio19:01:412
259940,0migration/222820-21if_eth1.220:11:442
259940,0migration/214387-21kthreadcore18:51:452
259940,0migration/214175-21kthreadcore20:26:462
259940,0migration/211168-21kthreadcore19:36:462
249940,0watchdog/26559-21runrttasks19:16:422
249940,0watchdog/22801-21grep19:31:462
249940,0watchdog/211571-21kthreadcore19:11:462
249940,0watchdog/20-21swapper/222:21:332
249940,0watchdog/20-21swapper/219:06:462
179940,0migration/19890-21kthreadcore22:51:431
179940,0migration/14580-21kthreadcore19:06:461
179940,0migration/13305-21kthreadcore19:31:461
179940,0migration/129216-21kthreadcore21:21:461
179940,0migration/126596-21taskset19:26:351
179940,0migration/122664-21runrttasks00:01:311
179940,0migration/122043-21taskset00:00:181
179940,0migration/121697-21kthreadcore22:16:441
179940,0migration/121448-21missed_timers20:31:471
179940,0migration/121373-21kthreadcore19:21:461
179940,0migration/120208-21kthreadcore22:56:421
179940,0migration/116143-21kthreadcore18:51:461
179940,0migration/111542-21fschecks_time21:31:421
179940,0migration/110262-21kthreadcore20:01:441
169940,0watchdog/18639-21cat20:21:501
169940,0watchdog/15567-21ssh23:48:451
169940,0watchdog/15137-21kthreadcore21:46:451
169940,0watchdog/130565-21kthreadcore21:41:451
169940,0watchdog/12642-21if_err_eth019:56:421
169940,0watchdog/12389-21kthreadcore22:26:451
169940,0watchdog/122755-21kthreadcore19:46:461
169940,0watchdog/118529-21ssh21:14:291
169940,0watchdog/113495-21cut20:26:461
169940,0watchdog/110115-21ssh20:47:331
169940,0watchdog/10-21swapper/123:31:451
169940,0watchdog/10-21swapper/122:46:451
169940,0watchdog/10-21swapper/120:06:461
149940,0migration/023279-21proc_pri22:16:470
54569932,0cyclictest31495-21cut19:26:452
54569930,0cyclictest2828-21aten2.4-expect20:21:382
54559933,0cyclictest3556-21lldpd20:41:311
54559932,0cyclictest8895-21awk23:11:421
54559932,0cyclictest8579-21awk19:36:441
54559932,0cyclictest5927-21cut18:46:401
54559931,0cyclictest15072-21kthreadcore20:51:441
54559930,0cyclictest32711-21df_inode23:06:401
54559930,0cyclictest32711-21df_inode23:06:401
54549933,0cyclictest9432-21awk22:51:420
54549933,0cyclictest3556-21lldpd23:46:320
54549933,0cyclictest20684-21kworker/0:023:41:380
54549933,0cyclictest20684-21kworker/0:023:11:440
54549933,0cyclictest20684-21kworker/0:023:01:380
54549933,0cyclictest20684-21kworker/0:022:21:280
54549933,0cyclictest20684-21kworker/0:022:02:020
54549933,0cyclictest20684-21kworker/0:021:41:300
54549933,0cyclictest20684-21kworker/0:021:36:580
54549933,0cyclictest20684-21kworker/0:021:26:420
54549933,0cyclictest20684-21kworker/0:020:51:390
54549933,0cyclictest20684-21kworker/0:020:41:350
54549933,0cyclictest20684-21kworker/0:020:26:310
54549933,0cyclictest20684-21kworker/0:020:06:390
54549933,0cyclictest20684-21kworker/0:019:56:350
54549933,0cyclictest10693-21kworker/0:219:21:310
54549933,0cyclictest10693-21kworker/0:218:46:330
54549932,0cyclictest3556-21lldpd20:16:310
54549930,0cyclictest20480-21perl20:56:440
29715030,0irq/26-eth0-rx-0-21swapper/320:41:433
29715030,0irq/26-eth0-rx-0-21swapper/319:50:413
29715030,0irq/26-eth0-rx-0-21swapper/319:43:313
29715030,0irq/26-eth0-rx-0-21swapper/319:36:453
29715030,0irq/26-eth0-rx-0-21swapper/319:26:403
29715030,0irq/26-eth0-rx-0-21swapper/319:11:323
179930,0migration/115850-21sh23:16:361
169930,0watchdog/10-21swapper/123:03:211
169930,0watchdog/10-21swapper/119:16:421
29715020,0irq/26-eth0-rx-0-21swapper/320:36:423
29715020,0irq/26-eth0-rx-0-21swapper/320:31:403
29715020,0irq/26-eth0-rx-0-21swapper/319:23:173
29715020,0irq/26-eth0-rx-0-21swapper/319:06:403
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional