You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-19 - 23:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2s.osadl.org (updated Sat Sep 19, 2026 12:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
967926463,0sleep30-21swapper/306:39:473
979623823,0sleep00-21swapper/006:41:040
991323624,0sleep10-21swapper/106:42:291
974223127,0sleep20-21swapper/206:40:302
100709977,0cyclictest8276-21diskmemload11:13:400
35160,0ktimersoftd/30-21swapper/308:50:593
339960,0migration/35370-21switchtime09:38:493
339960,0migration/325670-21timerandwakeup08:03:503
339960,0migration/320872-21sh10:30:063
339960,0migration/320535-21taskset11:12:133
339960,0migration/318815-21sh12:11:523
339960,0migration/312317-21sh10:44:373
29725060,0irq/27-eth0-tx-13866-21kthreadcore11:48:432
29715060,0irq/26-eth0-rx-9429-21if_err_eth1.309:03:443
29715060,0irq/26-eth0-rx-6209-21python08:58:493
149960,0migration/031375-21sh09:37:430
149960,0migration/014496-21sh10:08:010
149960,0migration/014102-21idleruntime11:08:430
100719965,0cyclictest13338-21ssh10:47:411
35150,0ktimersoftd/30-21swapper/310:20:043
35150,0ktimersoftd/30-21swapper/307:08:493
339950,0migration/39117-21kthreadcore10:23:453
339950,0migration/38547-21kthreadcore10:03:443
339950,0migration/38302-21kthreadcore07:03:443
339950,0migration/37741-21kthreadcore11:43:453
339950,0migration/37047-21kthreadcore11:23:433
339950,0migration/332338-21runrttasks08:58:093
339950,0migration/329268-21kthreadcore08:08:453
339950,0migration/327518-21aten_r1power_en08:33:383
339950,0migration/327067-21kthreadcore09:53:443
339950,0migration/32573-21kthreadcore08:13:473
339950,0migration/324914-21kthreadcore10:13:473
339950,0migration/324362-21hddtemp_smartct06:53:413
339950,0migration/323587-21munin-node07:13:493
339950,0migration/322588-21munin-node06:48:493
339950,0migration/318218-21kthreadcore09:08:453
339950,0migration/317050-21kthreadcore11:48:443
339950,0migration/31389-21kthreadcore10:58:463
339950,0migration/313178-21kthreadcore06:43:453
339950,0migration/310511-21kthreadcore08:18:463
29725050,0irq/27-eth0-tx-7527-21munin-node08:18:480
29725050,0irq/27-eth0-tx-7518-21munin-node09:43:402
29725050,0irq/27-eth0-tx-7518-21munin-node09:43:402
29725050,0irq/27-eth0-tx-2935-21cut08:58:442
29725050,0irq/27-eth0-tx-25077-21grep09:53:442
29725050,0irq/27-eth0-tx-23964-21munin-node09:33:492
29725050,0irq/27-eth0-tx-22908-21grep11:33:462
29725050,0irq/27-eth0-tx-17086-21irqcore09:28:452
29725050,0irq/27-eth0-tx-15459-21munin-node09:48:492
29725050,0irq/27-eth0-tx-14923-21munin-node10:08:422
29725050,0irq/27-eth0-tx-14136-21sed09:23:492
29725050,0irq/27-eth0-tx-0-21swapper/210:42:212
29725050,0irq/27-eth0-tx-0-21swapper/210:28:252
29725050,0irq/27-eth0-tx-0-21swapper/209:11:532
29725050,0irq/27-eth0-tx-0-21swapper/008:43:530
29715050,0irq/26-eth0-rx-4558-21ntp_offset09:58:473
29715050,0irq/26-eth0-rx-29969-21unixbench_multi09:33:523
29715050,0irq/26-eth0-rx-287552sleep311:38:383
29715050,0irq/26-eth0-rx-25375-21if_err_eth1.209:13:423
29715050,0irq/26-eth0-rx-21261-21ssh10:52:453
29715050,0irq/26-eth0-rx-17815-21kthreadcore11:28:463
29715050,0irq/26-eth0-rx-0-21swapper/312:08:263
29715050,0irq/26-eth0-rx-0-21swapper/311:58:283
29715050,0irq/26-eth0-rx-0-21swapper/311:53:403
29715050,0irq/26-eth0-rx-0-21swapper/311:36:163
29715050,0irq/26-eth0-rx-0-21swapper/311:18:443
29715050,0irq/26-eth0-rx-0-21swapper/311:17:173
29715050,0irq/26-eth0-rx-0-21swapper/310:53:303
29715050,0irq/26-eth0-rx-0-21swapper/310:41:493
29715050,0irq/26-eth0-rx-0-21swapper/310:33:403
29715050,0irq/26-eth0-rx-0-21swapper/310:10:203
29715050,0irq/26-eth0-rx-0-21swapper/309:18:403
29715050,0irq/26-eth0-rx-0-21swapper/307:48:453
259950,0migration/28342-21latency_hist08:43:282
259950,0migration/25275-21fschecks_count11:23:402
259950,0migration/232153-21idleruntime09:58:412
259950,0migration/230406-21timerandwakeup09:13:502
259950,0migration/227251-21sh11:56:432
259950,0migration/224244-21kthreadcore11:13:442
259950,0migration/21519-21kthreadcore11:18:442
259950,0migration/213369-21aten_r1power_fr11:08:402
259950,0migration/212873-21sh11:08:062
249950,0watchdog/26453-21cat11:43:452
249950,0watchdog/230054-21kthreadcore07:43:462
249950,0watchdog/213218-21grep12:08:452
179950,0migration/18847-21kthreadcore07:53:461
179950,0migration/16424-21munin-node08:58:501
179950,0migration/14499-21sh10:40:191
179950,0migration/13842-21aten_r1power_vo12:03:381
179950,0migration/13425-21kthreadcore10:18:451
179950,0migration/128248-21taskset10:54:461
179950,0migration/126457-21kthreadcore09:33:461
179950,0migration/125953-21kthreadcore07:18:451
179950,0migration/119533-21fschecks_time07:38:411
179950,0migration/119095-21kthreadcore08:23:441
179950,0migration/117894-21kthreadcore10:48:451
179950,0migration/115006-21sh08:45:131
169950,0watchdog/130053-21kthreadcore07:43:461
169950,0watchdog/116003-21munin-node09:28:491
149950,0migration/08327-21cpuspeed_turbos09:23:380
149950,0migration/06809-21sh09:20:290
149950,0migration/05537-21sh10:21:410
149950,0migration/04871-21fschecks_time11:43:410
149950,0migration/030167-21kthreadcore08:08:450
149950,0migration/029714-21sh09:54:230
149950,0migration/028507-21kthreadcore07:43:450
149950,0migration/027666-21kthreadcore06:53:450
149950,0migration/027404-21kthreadcore07:18:460
149950,0migration/02589-21kthreadcore09:38:440
149950,0migration/024996-21kthreadcore08:03:450
149950,0migration/024593-21kthreadcore08:28:470
149950,0migration/023480-21irqrtprio10:33:430
149950,0migration/02195-21fschecks_count08:38:410
149950,0migration/020790-21kthreadcore09:28:470
149950,0migration/020617-21latency_hist11:33:260
149950,0migration/019604-21kthreadcore10:28:470
149950,0migration/01885-21kthreadcore07:23:460
149950,0migration/018637-21kthreadcore10:08:460
149950,0migration/018593-21taskset07:37:450
149950,0migration/01584-21kthreadcore10:38:450
149950,0migration/01477-21kthreadcore06:58:460
149950,0migration/014197-21kthreadcore11:28:450
149950,0migration/013666-21fschecks_count07:58:400
149950,0migration/012502-21kthreadcore09:43:460
149950,0migration/012502-21kthreadcore09:43:460
149950,0migration/011956-21sh11:26:480
149950,0migration/011256-21kthreadcore09:03:460
100729955,0cyclictest0-21swapper/212:02:072
100729955,0cyclictest0-21swapper/210:13:492
100729950,0cyclictest0-21swapper/209:22:152
100719955,0cyclictest0-21swapper/110:13:191
100719955,0cyclictest0-21swapper/109:23:201
100719950,0cyclictest0-21swapper/111:52:011
100719950,0cyclictest0-21swapper/109:46:021
100719950,0cyclictest0-21swapper/109:46:021
100709955,0cyclictest17413-21kworker/0:012:11:460
100709955,0cyclictest17413-21kworker/0:011:58:440
100709955,0cyclictest17413-21kworker/0:011:18:440
100709955,0cyclictest17413-21kworker/0:010:49:400
100709955,0cyclictest17413-21kworker/0:010:47:020
100709955,0cyclictest17413-21kworker/0:009:10:170
100709955,0cyclictest17413-21kworker/0:008:48:470
100709955,0cyclictest0-21swapper/011:53:430
100709950,0cyclictest0-21swapper/010:56:390
100709950,0cyclictest0-21swapper/010:26:030
339940,0migration/37968-21kthreadcore07:28:453
339940,0migration/317951-21kthreadcore07:58:453
339940,0migration/310716-21kthreadcore09:43:453
339940,0migration/310716-21kthreadcore09:43:453
29725040,0irq/27-eth0-tx-2674-21ssh11:39:472
29725040,0irq/27-eth0-tx-24482-21ssh08:53:312
29725040,0irq/27-eth0-tx-0-21swapper/212:03:322
29725040,0irq/27-eth0-tx-0-21swapper/210:53:412
29725040,0irq/27-eth0-tx-0-21swapper/210:43:342
29725040,0irq/27-eth0-tx-0-21swapper/210:35:022
29725040,0irq/27-eth0-tx-0-21swapper/210:28:572
29725040,0irq/27-eth0-tx-0-21swapper/210:18:512
29725040,0irq/27-eth0-tx-0-21swapper/208:48:492
29725040,0irq/27-eth0-tx-0-21swapper/208:45:522
29725040,0irq/27-eth0-tx-0-21swapper/008:23:420
29725040,0irq/27-eth0-tx-0-21swapper/007:48:510
29725040,0irq/27-eth0-tx-0-21swapper/006:43:390
29715040,0irq/26-eth0-rx-0-21swapper/311:05:113
29715040,0irq/26-eth0-rx-0-21swapper/309:48:563
29715040,0irq/26-eth0-rx-0-21swapper/309:28:323
29715040,0irq/26-eth0-rx-0-21swapper/309:23:323
29715040,0irq/26-eth0-rx-0-21swapper/308:44:403
29715040,0irq/26-eth0-rx-0-21swapper/307:53:463
259940,0migration/28529-21munin-node09:03:402
259940,0migration/25617-21aten_r1power_fr07:28:402
259940,0migration/24397-21pmu-power07:23:502
259940,0migration/231241-21if_eth1.306:58:442
259940,0migration/229508-21kthreadcore08:08:452
259940,0migration/224899-21kthreadcore08:03:452
259940,0migration/218973-21sh11:29:102
259940,0migration/214170-21cpuspeed_turbos10:48:402
259940,0migration/212503-21netstat10:03:462
249940,0watchdog/29882-21kthreadcore08:18:462
249940,0watchdog/20-21swapper/207:03:462
179940,0migration/19033-21fschecks_count09:03:421
179940,0migration/17716-21timerwakeupswit08:38:501
179940,0migration/15508-21kernelversion11:43:441
179940,0migration/1414-21kthreadcore09:58:441
179940,0migration/128868-21kthreadcore08:08:451
179940,0migration/124732-21irqcore06:53:441
179940,0migration/123687-21timerandwakeup07:13:501
179940,0migration/120840-21runrttasks08:28:381
179940,0migration/119266-21taskset07:59:031
179940,0migration/11598-21kthreadcore07:48:441
179940,0migration/112143-21fschecks_count12:08:411
179940,0migration/110324-21switchtime07:03:491
169940,0watchdog/18065-21munin-node09:23:411
169940,0watchdog/15497-21cat09:38:491
169940,0watchdog/1488-21kthreadcore07:23:461
169940,0watchdog/111565-21ssh11:04:051
169940,0watchdog/10-21swapper/111:58:411
169940,0watchdog/10-21swapper/110:23:451
169940,0watchdog/10-21swapper/109:48:411
149940,0migration/09987-21kthreadcore11:03:470
149940,0migration/07926-21kthreadcore07:03:440
149940,0migration/030369-21sh10:17:550
149940,0migration/019377-21fschecks_count07:38:410
149940,0migration/018566-21fschecks_time07:13:410
100729943,0cyclictest7416-21awk07:53:442
100729943,0cyclictest400-21awk09:38:422
100729943,0cyclictest3514-21snmpd11:00:172
100729943,0cyclictest3514-21snmpd08:38:162
100729943,0cyclictest3514-21snmpd08:23:312
100729943,0cyclictest30044-21munin-run06:58:282
100729943,0cyclictest21680-21awk08:28:442
100729943,0cyclictest17889-21awk06:48:432
100729943,0cyclictest11213-21awk06:43:432
100719944,0cyclictest0-21swapper/110:31:361
100719944,0cyclictest0-21swapper/108:35:251
100719943,0cyclictest5803-21awk11:23:421
100719943,0cyclictest3556-21lldpd11:33:491
100719943,0cyclictest3556-21lldpd08:23:181
100719943,0cyclictest3556-21lldpd07:00:471
100719943,0cyclictest3241-21irqbalance11:41:051
100719943,0cyclictest3241-21irqbalance11:32:551
100719943,0cyclictest3241-21irqbalance11:13:051
100719943,0cyclictest3241-21irqbalance10:34:051
100719943,0cyclictest3241-21irqbalance09:13:361
100719943,0cyclictest3241-21irqbalance09:12:561
100719943,0cyclictest3241-21irqbalance08:53:461
100719943,0cyclictest3241-21irqbalance08:49:461
100719943,0cyclictest24310-21awk09:53:421
100719943,0cyclictest23751-21awk10:13:451
100719943,0cyclictest22200-21awk11:13:421
100719943,0cyclictest21016-21awk11:53:421
100719943,0cyclictest12912-21cat10:03:501
100719940,0cyclictest0-21swapper/107:35:261
100709944,0cyclictest17413-21kworker/0:012:04:420
100709944,0cyclictest17413-21kworker/0:011:51:440
100709944,0cyclictest17413-21kworker/0:011:39:400
100709944,0cyclictest17413-21kworker/0:009:16:050
100709944,0cyclictest17413-21kworker/0:009:00:510
100709943,0cyclictest7503-21awk07:53:450
100709943,0cyclictest3556-21lldpd09:59:490
100709943,0cyclictest3556-21lldpd08:15:190
100709943,0cyclictest3514-21snmpd09:49:310
100709943,0cyclictest25745-21ps08:53:450
29715030,0irq/26-eth0-rx-0-21swapper/308:38:393
29715030,0irq/26-eth0-rx-0-21swapper/308:31:133
29715030,0irq/26-eth0-rx-0-21swapper/308:26:103
29715030,0irq/26-eth0-rx-0-21swapper/307:35:293
29715030,0irq/26-eth0-rx-0-21swapper/307:23:463
29715030,0irq/26-eth0-rx-0-21swapper/306:59:503
249930,0watchdog/20-21swapper/207:48:422
179930,0migration/117547-21runrttasks07:11:571
169930,0watchdog/10-21swapper/110:59:011
100729932,0cyclictest19781-21awk07:38:422
100729932,0cyclictest18236-21expr07:13:402
100729932,0cyclictest16918-21sensors07:08:482
100729932,0cyclictest13485-21expr07:58:402
100729932,0cyclictest13135-21awk07:33:422
100729930,0cyclictest24964-21sed07:18:412
100729930,0cyclictest1516-21hddtemp_smartct08:13:442
100719933,0cyclictest0-21swapper/111:22:131
100719932,0cyclictest5929-21diskstats07:28:411
100719932,0cyclictest3556-21lldpd06:49:171
100719932,0cyclictest3241-21irqbalance06:43:461
100719932,0cyclictest20734-21awk08:03:421
100719931,0cyclictest2947-21kthreadcore08:13:471
100709933,0cyclictest17413-21kworker/0:010:58:280
100709933,0cyclictest17413-21kworker/0:007:28:290
100709933,0cyclictest17413-21kworker/0:007:08:290
100709933,0cyclictest17413-21kworker/0:006:48:290
100709932,0cyclictest31122-21kthreadcore08:33:440
29715020,0irq/26-eth0-rx-0-21swapper/307:43:293
29715020,0irq/26-eth0-rx-0-21swapper/307:38:583
29715020,0irq/26-eth0-rx-0-21swapper/307:19:083
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional