You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-09 - 12:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot2s.osadl.org (updated Sat May 09, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304450550,0irq/25-eth10-21swapper/318:54:293
1441123622,0sleep00-21swapper/018:54:100
1430723425,0sleep20-21swapper/218:52:562
1452123127,0sleep10-21swapper/118:55:271
339960,0migration/328790-21sh22:46:143
339960,0migration/319428-21sh21:56:403
339960,0migration/319161-21pmu-power21:36:303
339960,0migration/318371-21sh00:18:493
339960,0migration/313066-21munin-node23:16:253
339960,0migration/312445-21sh21:14:023
339960,0migration/311155-21idleruntime-cro00:16:093
339960,0migration/310523-21sh23:53:293
29715060,0irq/26-eth0-rx-28864-21if_err_eth1.223:46:243
259960,0migration/23584-21aten_r1power_en19:36:222
146549966,0cyclictest0-21swapper/122:09:091
146549960,0cyclictest0-21swapper/123:03:521
146539960,0cyclictest0-21swapper/023:21:250
149960,0migration/028305-21sh21:43:200
149960,0migration/023816-21kthreadcore22:41:270
149960,0migration/023192-21mdstat20:11:280
149960,0migration/018937-21sh23:18:090
8215050,0irq/24-0000:00:5010-21latency_hist21:51:112
8215050,0irq/24-0000:00:28171-21cat23:26:102
4150,0ktimersoftd/00-21swapper/018:56:230
339950,0migration/37291-21kthreadcore23:11:263
339950,0migration/3496-21kthreadcore19:31:283
339950,0migration/34462-21latency_hist20:01:113
339950,0migration/329919-21munin-node22:06:223
339950,0migration/329609-21ksmtuned19:51:533
339950,0migration/327925-21diskmemload21:02:423
339950,0migration/327642-21latency_hist00:06:103
339950,0migration/325754-21taskset23:41:303
339950,0migration/322621-21kthreadcore23:01:263
339950,0migration/319956-21fschecks_count00:21:233
339950,0migration/316370-21kthreadcore22:16:283
339950,0migration/316370-21kthreadcore22:16:283
339950,0migration/315947-21irqcore18:56:263
339950,0migration/31440-21munin-node19:06:323
339950,0migration/311329-21sh22:32:453
29725050,0irq/27-eth0-tx-30515-21munin-node21:06:242
29725050,0irq/27-eth0-tx-28824-21ssh22:05:422
29725050,0irq/27-eth0-tx-18325-21ssh22:56:302
29725050,0irq/27-eth0-tx-12189-21ssh22:35:152
29725050,0irq/27-eth0-tx-12002-21ssh21:53:202
29725050,0irq/27-eth0-tx-0-21swapper/223:13:542
29725050,0irq/27-eth0-tx-0-21swapper/222:50:512
29725050,0irq/27-eth0-tx-0-21swapper/221:33:112
29725050,0irq/27-eth0-tx-0-21swapper/200:07:192
29725050,0irq/27-eth0-tx-0-21swapper/020:56:250
29725050,0irq/27-eth0-tx-0-21swapper/020:45:240
29725050,0irq/27-eth0-tx-0-21swapper/020:26:120
29725050,0irq/27-eth0-tx-0-21swapper/020:20:440
29725050,0irq/27-eth0-tx-0-21swapper/019:56:420
29725050,0irq/27-eth0-tx-0-21swapper/019:46:210
29715050,0irq/26-eth0-rx-22353-21fschecks_time21:21:233
29715050,0irq/26-eth0-rx-21614-21grep23:21:253
29715050,0irq/26-eth0-rx-15315-21grep21:16:273
29715050,0irq/26-eth0-rx-0-21swapper/323:57:343
29715050,0irq/26-eth0-rx-0-21swapper/323:31:253
29715050,0irq/26-eth0-rx-0-21swapper/323:00:253
29715050,0irq/26-eth0-rx-0-21swapper/322:41:263
29715050,0irq/26-eth0-rx-0-21swapper/322:28:313
29715050,0irq/26-eth0-rx-0-21swapper/322:12:363
29715050,0irq/26-eth0-rx-0-21swapper/322:01:233
29715050,0irq/26-eth0-rx-0-21swapper/321:06:263
29715050,0irq/26-eth0-rx-0-21swapper/300:01:233
259950,0migration/231638-21kthreadcore23:06:262
259950,0migration/227070-21sh23:23:292
259950,0migration/225245-21kthreadcore19:26:272
259950,0migration/219639-21latency_hist00:01:102
259950,0migration/217893-21pmu-power23:16:312
259950,0migration/212727-21kernelversion00:16:272
249950,0watchdog/29893-21sed22:51:282
249950,0watchdog/216078-21timerwakeupswit19:41:332
179950,0migration/1360-21kthreadcore20:21:261
179950,0migration/131499-21kthreadcore21:46:271
179950,0migration/127657-21latency_hist00:06:101
179950,0migration/126222-21kthreadcore20:16:271
179950,0migration/125908-21kthreadcore22:01:271
179950,0migration/118435-21taskset23:58:121
179950,0migration/117079-21kthreadcore21:56:261
179950,0migration/110470-21kernelversion19:16:271
146569950,0cyclictest0-21swapper/223:45:252
146569950,0cyclictest0-21swapper/222:19:012
146569950,0cyclictest0-21swapper/222:19:012
146549955,0cyclictest0-21swapper/122:17:401
146549955,0cyclictest0-21swapper/122:17:401
146549955,0cyclictest0-21swapper/121:28:481
146549950,0cyclictest0-21swapper/123:25:371
146549950,0cyclictest0-21swapper/123:00:521
146549950,0cyclictest0-21swapper/122:54:521
146549950,0cyclictest0-21swapper/121:53:331
146549950,0cyclictest0-21swapper/121:24:421
146539955,0cyclictest0-21swapper/022:49:340
146539950,0cyclictest12916-21diskmemload22:52:340
146539950,0cyclictest0-21swapper/022:39:280
146539950,0cyclictest0-21swapper/022:31:170
146539950,0cyclictest0-21swapper/021:03:370
149950,0migration/08538-21kthreadcore20:01:270
149950,0migration/06369-21kthreadcore00:11:260
149950,0migration/05185-21needreboot20:46:300
149950,0migration/04923-21aten_r1power_en22:11:200
149950,0migration/04659-21latency_hist22:11:110
149950,0migration/02777-21kthreadcore21:26:270
149950,0migration/024819-21kthreadcore23:41:260
149950,0migration/024165-21kthreadcore22:21:270
149950,0migration/023271-21fschecks_time19:26:230
149950,0migration/022637-21kthreadcore00:01:270
149950,0migration/022016-21cpuspeed_turbos21:21:210
149950,0migration/021397-21aten_r1power_vo22:01:210
149950,0migration/02010-21kthreadcore20:21:270
149950,0migration/019860-21taskset22:18:500
149950,0migration/019860-21taskset22:18:500
149950,0migration/018514-21kthreadcore21:56:260
149950,0migration/013628-21kthreadcore20:31:260
149950,0migration/013498-21kthreadcore23:36:270
149950,0migration/01257-21sh23:26:270
149950,0migration/012556-21sh21:14:190
149950,0migration/011329-21runrttasks21:31:320
149950,0migration/011255-21taskset23:14:070
149950,0migration/010165-21sh23:31:470
339940,0migration/36462-21if_eth021:31:243
339940,0migration/33687-21timerandwakeup19:56:323
339940,0migration/329815-21mdstat20:16:293
339940,0migration/324534-21kthreadcore22:21:273
339940,0migration/321776-21timerwakeupswit19:21:323
339940,0migration/320540-21kthreadcore20:11:263
339940,0migration/313129-21latency_hist20:56:113
339940,0migration/310906-21kthreadcore20:51:273
29725040,0irq/27-eth0-tx-7593-21cut00:11:262
29725040,0irq/27-eth0-tx-3890-21ssh23:31:142
29725040,0irq/27-eth0-tx-3650-21ssh23:51:122
29725040,0irq/27-eth0-tx-27888-21ssh21:02:372
29725040,0irq/27-eth0-tx-21219-21ssh22:41:232
29725040,0irq/27-eth0-tx-0-21swapper/223:59:242
29725040,0irq/27-eth0-tx-0-21swapper/222:26:192
29725040,0irq/27-eth0-tx-0-21swapper/221:36:372
29725040,0irq/27-eth0-tx-0-21swapper/221:26:542
29725040,0irq/27-eth0-tx-0-21swapper/221:16:112
29725040,0irq/27-eth0-tx-0-21swapper/200:21:192
29725040,0irq/27-eth0-tx-0-21swapper/019:51:220
29725040,0irq/27-eth0-tx-0-21swapper/019:36:250
29725040,0irq/27-eth0-tx-0-21swapper/019:08:240
29725040,0irq/27-eth0-tx-0-21swapper/019:01:200
29715040,0irq/26-eth0-rx-0-21swapper/323:36:263
29715040,0irq/26-eth0-rx-0-21swapper/323:26:263
29715040,0irq/26-eth0-rx-0-21swapper/323:06:513
29715040,0irq/26-eth0-rx-0-21swapper/322:51:323
29715040,0irq/26-eth0-rx-0-21swapper/322:36:403
29715040,0irq/26-eth0-rx-0-21swapper/321:52:103
29715040,0irq/26-eth0-rx-0-21swapper/321:48:233
29715040,0irq/26-eth0-rx-0-21swapper/321:41:263
29715040,0irq/26-eth0-rx-0-21swapper/321:26:263
29715040,0irq/26-eth0-rx-0-21swapper/319:46:223
259940,0migration/24820-21latency_hist22:11:112
259940,0migration/224944-21munin-node20:16:232
259940,0migration/224004-21kthreadcore19:01:262
259940,0migration/223751-21kthreadcore21:21:262
259940,0migration/219287-21kthreadcore19:46:272
259940,0migration/216939-21kthreadcore22:36:272
259940,0migration/216018-21kthreadcore20:56:262
259940,0migration/212955-21gltestperf20:31:232
249940,0watchdog/23151-21sh22:06:562
249940,0watchdog/227490-21sh23:04:002
249940,0watchdog/220578-21switchtime18:56:332
249940,0watchdog/214354-21irqcore21:56:252
249940,0watchdog/20-21swapper/221:41:212
179940,0migration/17601-21kthreadcore20:26:271
179940,0migration/17234-21kthreadcore21:31:261
179940,0migration/132253-21kthreadcore19:31:281
179940,0migration/129321-21idleruntime-cro21:46:111
179940,0migration/127422-21kthreadcore19:51:281
179940,0migration/126753-21irqrtprio20:41:261
179940,0migration/124242-21runrttasks20:15:271
179940,0migration/122877-21kthreadcore19:01:251
179940,0migration/112204-21hddtemp_smartct00:16:241
169940,0watchdog/15718-21ssh22:31:241
169940,0watchdog/127595-21ssh21:01:531
169940,0watchdog/124649-21kthreadcore00:21:281
169940,0watchdog/119815-21if_eth1.320:36:251
169940,0watchdog/117807-21munin-node19:46:251
169940,0watchdog/111940-21munin-node23:36:241
169940,0watchdog/111202-21ssh23:55:281
169940,0watchdog/10-21swapper/123:06:321
169940,0watchdog/10-21swapper/122:21:401
169940,0watchdog/10-21swapper/118:56:331
146569944,0cyclictest0-21swapper/219:06:312
146569943,0cyclictest5269-21sadc20:26:112
146569943,0cyclictest3556-21lldpd20:51:132
146569943,0cyclictest3556-21lldpd20:46:132
146569943,0cyclictest3556-21lldpd20:26:122
146569943,0cyclictest3556-21lldpd20:13:112
146569943,0cyclictest3556-21lldpd19:53:422
146569943,0cyclictest3556-21lldpd19:35:412
146569943,0cyclictest3556-21lldpd19:25:412
146569943,0cyclictest3556-21lldpd19:11:412
146569943,0cyclictest3514-21snmpd20:44:502
146569943,0cyclictest28996-21awk23:46:252
146569943,0cyclictest21816-21awk22:21:242
146569943,0cyclictest12895-21awk23:36:252
146569940,0cyclictest5342-21munin-node21:11:262
146549944,0cyclictest0-21swapper/122:38:481
146549944,0cyclictest0-21swapper/119:26:361
146549943,0cyclictest3556-21lldpd23:43:451
146549943,0cyclictest3556-21lldpd23:28:151
146549943,0cyclictest3556-21lldpd23:11:451
146549943,0cyclictest3556-21lldpd22:46:151
146549943,0cyclictest3556-21lldpd21:37:141
146549943,0cyclictest3556-21lldpd20:58:121
146549943,0cyclictest3556-21lldpd00:02:161
146549943,0cyclictest3514-21snmpd23:46:211
146549943,0cyclictest3514-21snmpd20:01:501
146549943,0cyclictest31085-21awk19:56:241
146549943,0cyclictest14534-21awk21:16:251
146549943,0cyclictest13118-21awk20:31:241
146539944,0cyclictest6328-21kworker/0:122:26:260
146539944,0cyclictest6328-21kworker/0:100:21:270
146539944,0cyclictest0-21swapper/023:07:320
146539943,0cyclictest3556-21lldpd21:10:140
146539943,0cyclictest3556-21lldpd00:18:460
146539943,0cyclictest19830-21awk20:36:250
146539943,0cyclictest14449-21awk21:36:240
146539943,0cyclictest12104-21awk20:06:250
146539943,0cyclictest10026-21awk19:16:250
146539940,0cyclictest15893-21munin-node19:21:230
149940,0migration/04199-21kthreadcore19:11:270
149940,0migration/030797-21kthreadcore23:46:270
149940,0migration/016394-21kthreadcore21:16:270
149940,0migration/013734-21kthreadcore23:56:260
149940,0migration/011613-21kthreadcore19:41:270
29715030,0irq/26-eth0-rx-0-21swapper/320:46:313
29715030,0irq/26-eth0-rx-0-21swapper/320:40:333
29715030,0irq/26-eth0-rx-0-21swapper/320:28:063
29715030,0irq/26-eth0-rx-0-21swapper/320:21:203
29715030,0irq/26-eth0-rx-0-21swapper/320:06:113
29715030,0irq/26-eth0-rx-0-21swapper/319:36:233
29715030,0irq/26-eth0-rx-0-21swapper/319:26:303
29715030,0irq/26-eth0-rx-0-21swapper/319:13:263
29715030,0irq/26-eth0-rx-0-21swapper/319:04:303
259930,0migration/212488-21irqrtprio20:06:272
249930,0watchdog/20-21swapper/219:17:532
179930,0migration/128171-21latency_hist19:06:111
179930,0migration/11328-21kthreadcore20:46:281
169930,0watchdog/10-21swapper/100:11:281
146569933,0cyclictest3556-21lldpd20:40:132
146569933,0cyclictest0-21swapper/220:01:232
146569930,0cyclictest0-21swapper/219:59:482
146549933,0cyclictest0-21swapper/119:21:241
146549932,0cyclictest6204-21awk21:11:241
146549932,0cyclictest4383-21awk19:36:251
146549932,0cyclictest3556-21lldpd23:31:151
146549932,0cyclictest3556-21lldpd22:45:451
146549932,0cyclictest3514-21snmpd19:41:201
146549932,0cyclictest3331-21awk19:11:251
146549932,0cyclictest29920-21awk22:26:231
146549932,0cyclictest13177-21awk23:16:251
146549932,0cyclictest10661-21sensors22:11:301
146549930,0cyclictest7203-21perl20:51:221
146539932,0cyclictest769-21grep21:46:280
146539932,0cyclictest6841-21df_abs20:51:210
146539932,0cyclictest5953-21perl21:51:230
146539932,0cyclictest4572-21awk23:51:240
146539932,0cyclictest3556-21lldpd00:07:170
146539932,0cyclictest29264-21munin-node19:31:220
146539932,0cyclictest21512-21awk23:01:240
146539930,0cyclictest18340-21python22:56:310
29715020,0irq/26-eth0-rx-0-21swapper/320:41:143
29715020,0irq/26-eth0-rx-0-21swapper/320:31:183
29715020,0irq/26-eth0-rx-0-21swapper/319:41:213
29715020,0irq/26-eth0-rx-0-21swapper/319:16:263
169920,0watchdog/10-21swapper/121:06:171
146549921,0cyclictest0-21swapper/120:06:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional