You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-02 - 06:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot2s.osadl.org (updated Wed Sep 02, 2026 00:43:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2800726156,0sleep20-21swapper/218:41:182
304450520,0irq/25-eth10-21swapper/318:42:503
2807324432,0sleep00-21swapper/018:42:040
2795323324,0sleep10-21swapper/118:40:411
339960,0migration/3899-21sh21:28:083
339960,0migration/38686-21munin-node22:55:223
339960,0migration/35462-21sh23:11:113
339960,0migration/331977-21fschecks_count20:00:223
339960,0migration/325964-21sh21:03:503
339960,0migration/317587-21sh21:18:333
339960,0migration/317170-21munin-node19:00:223
29715060,0irq/26-eth0-rx-24747-21python20:15:303
29715060,0irq/26-eth0-rx-24702-21ssh22:25:183
29715060,0irq/26-eth0-rx-16083-21ntp_kernel_err20:55:273
29715060,0irq/26-eth0-rx-14787-21ssh22:15:303
29715060,0irq/26-eth0-rx-0-21swapper/322:51:193
284089966,0cyclictest0-21swapper/200:00:262
284089960,0cyclictest0-21swapper/221:51:372
284079960,0cyclictest26463-21diskmemload21:22:101
284079960,0cyclictest0-21swapper/122:30:171
284069960,0cyclictest0-21swapper/019:10:300
259960,0migration/220938-21kthreadcore19:00:252
149960,0migration/06698-21sh22:31:260
149960,0migration/06342-21fschecks_time20:05:220
149960,0migration/031889-21sh22:07:040
149960,0migration/022777-21sh22:41:560
149960,0migration/022143-21sh23:23:370
149960,0migration/021718-21sh23:00:300
339950,0migration/3962-21kthreadcore23:30:233
339950,0migration/39303-21kthreadcore23:15:233
339950,0migration/39303-21kthreadcore23:15:233
339950,0migration/39302-21kthreadcore23:35:243
339950,0migration/36027-21kthreadcore19:15:243
339950,0migration/33041-21fschecks_time20:50:243
339950,0migration/329574-21kthreadcore22:05:253
339950,0migration/328990-21kthreadcore21:05:243
339950,0migration/324741-21runrttasks22:04:363
339950,0migration/324323-21kthreadcore23:45:243
339950,0migration/321818-21latency_hist00:05:063
339950,0migration/317666-21taskset19:46:473
339950,0migration/317511-21kthreadcore23:00:223
339950,0migration/317398-21kthreadcore23:20:243
339950,0migration/316602-21latency_hist22:20:073
339950,0migration/315000-21kthreadcore19:20:243
339950,0migration/312552-21timerwakeupswit20:30:313
29725050,0irq/27-eth0-tx-5469-21python22:50:292
29725050,0irq/27-eth0-tx-30508-21munin-node19:35:260
29725050,0irq/27-eth0-tx-25730-21munin-node21:45:322
29725050,0irq/27-eth0-tx-19079-21munin-node20:15:310
29725050,0irq/27-eth0-tx-0-21swapper/223:19:322
29725050,0irq/27-eth0-tx-0-21swapper/223:19:322
29725050,0irq/27-eth0-tx-0-21swapper/223:12:382
29725050,0irq/27-eth0-tx-0-21swapper/222:10:222
29725050,0irq/27-eth0-tx-0-21swapper/222:08:442
29725050,0irq/27-eth0-tx-0-21swapper/221:25:242
29725050,0irq/27-eth0-tx-0-21swapper/020:45:340
29725050,0irq/27-eth0-tx-0-21swapper/019:56:400
29725050,0irq/27-eth0-tx-0-21swapper/019:40:180
29725050,0irq/27-eth0-tx-0-21swapper/019:19:140
29715050,0irq/26-eth0-rx-7184-21ssh22:32:523
29715050,0irq/26-eth0-rx-4283-21kthreadcore21:30:253
29715050,0irq/26-eth0-rx-4154-21kthreadcore21:10:233
29715050,0irq/26-eth0-rx-23982-21irqcore23:25:233
29715050,0irq/26-eth0-rx-19994-21grep22:40:243
29715050,0irq/26-eth0-rx-0-21swapper/323:55:173
29715050,0irq/26-eth0-rx-0-21swapper/323:50:273
29715050,0irq/26-eth0-rx-0-21swapper/323:05:133
29715050,0irq/26-eth0-rx-0-21swapper/322:36:243
29715050,0irq/26-eth0-rx-0-21swapper/321:50:263
29715050,0irq/26-eth0-rx-0-21swapper/321:43:193
29715050,0irq/26-eth0-rx-0-21swapper/300:11:033
29715050,0irq/26-eth0-rx-0-21swapper/300:01:413
284089955,0cyclictest0-21swapper/222:29:562
284089955,0cyclictest0-21swapper/221:09:312
284089955,0cyclictest0-21swapper/200:06:342
284089954,0cyclictest2085-21crond20:50:072
284089950,0cyclictest0-21swapper/223:03:402
284089950,0cyclictest0-21swapper/222:23:002
284079955,0cyclictest26463-21diskmemload23:10:381
284079950,0cyclictest0-21swapper/123:41:041
284079950,0cyclictest0-21swapper/123:27:401
284079950,0cyclictest0-21swapper/120:56:471
284079950,0cyclictest0-21swapper/119:55:281
284069955,0cyclictest1552-21kworker/0:222:21:240
284069955,0cyclictest0-21swapper/021:15:320
284069955,0cyclictest0-21swapper/021:02:170
284069953,0cyclictest28963-21kworker/0:219:20:230
259950,0migration/25310-21kthreadcore19:15:232
259950,0migration/23931-21kthreadcore20:25:242
259950,0migration/219580-21kthreadcore23:40:252
259950,0migration/217939-21aten_r1power_po21:40:192
259950,0migration/217930-21kthreadcore20:35:252
259950,0migration/212017-21missed_timers23:35:262
249950,0watchdog/220903-21kthreadcore22:00:252
249950,0watchdog/219136-21grep23:20:252
249950,0watchdog/20-21swapper/221:35:212
179950,0migration/111496-21kthreadcore21:35:241
169950,0watchdog/111087-21kthreadcore23:35:251
149950,0migration/08075-21if_eth1.323:15:220
149950,0migration/08075-21if_eth1.323:15:220
149950,0migration/06423-21taskset20:29:200
149950,0migration/04163-21kthreadcore22:10:240
149950,0migration/032134-21kthreadcore23:50:250
149950,0migration/027847-21kthreadcore19:05:270
149950,0migration/026918-21irqrtprio20:20:250
149950,0migration/025175-21irqcore22:45:230
149950,0migration/023723-21latency_hist19:30:070
149950,0migration/022911-21taskset23:25:140
149950,0migration/022880-21kthreadcore21:40:250
149950,0migration/021979-21aten_r1power_en00:05:180
149950,0migration/02044-21sh21:09:490
149950,0migration/018873-21taskset20:35:280
149950,0migration/016909-21munin-node19:45:280
149950,0migration/015270-21sh22:38:160
149950,0migration/015239-21fschecks_time23:40:200
149950,0migration/012167-21kthreadcore21:55:240
339940,0migration/331140-21fschecks_time19:35:213
339940,0migration/329388-21hddtemp_smartct18:45:223
339940,0migration/328418-21kthreadcore20:45:233
339940,0migration/327919-21kthreadcore19:55:253
339940,0migration/325967-21unixbench_multi20:40:303
339940,0migration/321178-21kthreadcore21:20:253
339940,0migration/321137-21kthreadcore19:25:253
339940,0migration/314782-21cpuspeed_turbos23:40:193
339940,0migration/313901-21fschecks_count20:35:203
29725040,0irq/27-eth0-tx-26463-21diskmemload22:30:542
29725040,0irq/27-eth0-tx-0-21swapper/223:50:082
29725040,0irq/27-eth0-tx-0-21swapper/223:30:392
29725040,0irq/27-eth0-tx-0-21swapper/223:05:402
29725040,0irq/27-eth0-tx-0-21swapper/222:46:452
29725040,0irq/27-eth0-tx-0-21swapper/222:36:222
29725040,0irq/27-eth0-tx-0-21swapper/222:15:212
29725040,0irq/27-eth0-tx-0-21swapper/221:55:102
29725040,0irq/27-eth0-tx-0-21swapper/221:20:282
29725040,0irq/27-eth0-tx-0-21swapper/221:17:462
29725040,0irq/27-eth0-tx-0-21swapper/221:00:252
29725040,0irq/27-eth0-tx-0-21swapper/220:55:162
29725040,0irq/27-eth0-tx-0-21swapper/200:11:102
29725040,0irq/27-eth0-tx-0-21swapper/020:10:180
29725040,0irq/27-eth0-tx-0-21swapper/019:30:250
29725040,0irq/27-eth0-tx-0-21swapper/018:50:260
29715040,0irq/26-eth0-rx-5718-21sensors20:25:283
29715040,0irq/26-eth0-rx-0-21swapper/322:47:533
29715040,0irq/26-eth0-rx-0-21swapper/322:10:113
29715040,0irq/26-eth0-rx-0-21swapper/321:56:283
29715040,0irq/26-eth0-rx-0-21swapper/321:46:363
29715040,0irq/26-eth0-rx-0-21swapper/321:35:253
29715040,0irq/26-eth0-rx-0-21swapper/319:30:293
29715040,0irq/26-eth0-rx-0-21swapper/319:05:203
284089944,0cyclictest0-21swapper/223:48:082
284089943,0cyclictest5718-21awk19:40:212
284089943,0cyclictest3556-21lldpd19:20:102
284089943,0cyclictest3514-21snmpd19:27:332
284089943,0cyclictest3514-21snmpd18:49:032
284089943,0cyclictest23811-21awk23:25:222
284079944,0cyclictest0-21swapper/122:52:501
284079943,0cyclictest930-21awk20:25:221
284079943,0cyclictest5757-21awk19:40:221
284079943,0cyclictest5527-21sadc20:05:071
284079943,0cyclictest3556-21lldpd22:35:401
284079943,0cyclictest3556-21lldpd22:10:091
284079943,0cyclictest3556-21lldpd21:16:401
284079943,0cyclictest3556-21lldpd21:06:101
284079943,0cyclictest3556-21lldpd19:10:101
284079943,0cyclictest3514-21snmpd20:16:331
284079943,0cyclictest3514-21snmpd19:36:031
284079943,0cyclictest3359-21awk20:50:261
284079943,0cyclictest31346-21awk23:50:231
284079943,0cyclictest30794-21awk00:10:221
284079943,0cyclictest27309-21awk21:25:231
284079943,0cyclictest26604-21awk21:45:231
284079943,0cyclictest26121-21awk22:05:231
284079943,0cyclictest24381-21awk23:05:211
284079943,0cyclictest19030-21awk19:50:221
284079943,0cyclictest15987-21awk23:20:221
284079943,0cyclictest11571-21basename19:45:201
284069944,0cyclictest0-21swapper/021:12:130
284069943,0cyclictest443-21awk22:50:220
284069943,0cyclictest3514-21snmpd21:30:180
284069943,0cyclictest3514-21snmpd19:02:180
284069943,0cyclictest3514-21snmpd00:04:340
284069943,0cyclictest3241-21irqbalance23:36:350
284069943,0cyclictest3241-21irqbalance23:32:350
284069943,0cyclictest3241-21irqbalance22:15:250
284069943,0cyclictest3241-21irqbalance21:36:550
284069943,0cyclictest3241-21irqbalance21:26:150
284069943,0cyclictest3241-21irqbalance20:55:360
284069943,0cyclictest3241-21irqbalance20:50:460
284069943,0cyclictest20935-21awk20:40:210
284069943,0cyclictest13157-21sadc20:35:070
284069940,0cyclictest16074-21basename19:00:070
259940,0migration/28864-21irqrtprio22:55:232
259940,0migration/28602-21kthreadcore20:30:252
259940,0migration/28019-21kthreadcore18:50:262
259940,0migration/23863-21kthreadcore21:10:232
259940,0migration/231718-21cpuspeed_turbos20:00:202
259940,0migration/229208-21missed_timers19:30:292
259940,0migration/22630-21ntp_kernel_pll_19:10:272
259940,0migration/226158-21fschecks_count20:20:222
259940,0migration/226097-21taskset20:41:032
259940,0migration/224244-21munin-node19:05:262
259940,0migration/222989-21kthreadcore19:50:252
259940,0migration/22296-21fschecks_count21:30:212
259940,0migration/216507-21df_abs22:40:192
259940,0migration/216275-21kthreadcore20:10:242
259940,0migration/210819-21kthreadcore23:55:242
249940,0watchdog/22450-21aten_r1power_fr20:50:212
249940,0watchdog/215883-21chrt18:58:142
249940,0watchdog/213690-21cut19:45:262
179940,0migration/13982-21missed_timers23:30:251
179940,0migration/131671-21kthreadcore20:45:241
179940,0migration/126422-21kthreadcore22:25:241
179940,0migration/124212-21taskset21:41:231
179940,0migration/124099-21kthreadcore00:05:241
179940,0migration/121584-21munin-node19:00:261
179940,0migration/121167-21kthreadcore21:00:231
179940,0migration/117700-21kthreadcore20:35:251
179940,0migration/113264-21munin-node22:55:271
179940,0migration/111541-21kthreadcore21:55:241
179940,0migration/110663-21kthreadcore22:15:231
169940,0watchdog/19516-21kthreadcore20:30:251
169940,0watchdog/129888-21python22:45:291
169940,0watchdog/129255-21perl18:45:221
169940,0watchdog/125637-21kthreadcore23:45:251
169940,0watchdog/124705-21kthreadcore19:05:261
169940,0watchdog/122609-21ssh23:03:131
169940,0watchdog/111453-21memory23:55:251
169940,0watchdog/10-21swapper/122:22:411
169940,0watchdog/10-21swapper/122:00:251
169940,0watchdog/10-21swapper/121:50:251
169940,0watchdog/10-21swapper/119:20:301
149940,0migration/024549-21latency_hist22:25:070
149940,0migration/02392-21kthreadcore20:00:260
149940,0migration/022607-21kthreadcore21:20:260
8215030,0irq/24-0000:00:0-21swapper/220:10:022
29715030,0irq/26-eth0-rx-0-21swapper/320:21:583
29715030,0irq/26-eth0-rx-0-21swapper/320:12:153
29715030,0irq/26-eth0-rx-0-21swapper/320:07:433
29715030,0irq/26-eth0-rx-0-21swapper/319:50:193
29715030,0irq/26-eth0-rx-0-21swapper/319:40:223
29715030,0irq/26-eth0-rx-0-21swapper/318:55:193
29715030,0irq/26-eth0-rx-0-21swapper/318:54:333
284089932,0cyclictest3514-21snmpd20:17:332
284089932,0cyclictest31416-21awk19:35:232
284079933,0cyclictest0-21swapper/120:10:071
284079932,0cyclictest6716-21awk20:05:241
284079932,0cyclictest4807-21awk19:15:221
284079932,0cyclictest22869-21sensors19:25:291
284079932,0cyclictest20890-21awk20:40:211
284079932,0cyclictest17091-21awk22:40:221
284079931,0cyclictest0-21swapper/123:15:241
284079931,0cyclictest0-21swapper/123:15:241
284079930,0cyclictest3902-21awk18:50:231
284069933,0cyclictest6629-21kworker/0:023:45:180
284069933,0cyclictest6629-21kworker/0:000:10:200
284069933,0cyclictest28963-21kworker/0:219:50:190
284069933,0cyclictest28963-21kworker/0:218:45:210
284069933,0cyclictest19174-21kworker/0:122:00:180
284069933,0cyclictest19174-21kworker/0:121:50:080
284069933,0cyclictest19174-21kworker/0:121:45:100
284069933,0cyclictest1552-21kworker/0:223:10:120
284069933,0cyclictest1552-21kworker/0:223:05:100
284069933,0cyclictest1552-21kworker/0:222:55:080
284069932,0cyclictest9570-21kthreadcore23:55:230
249930,0watchdog/20-21swapper/219:55:262
179930,0migration/113865-21latency_hist00:00:061
169930,0watchdog/127999-21kthreadcore20:20:261
169930,0watchdog/10-21swapper/121:30:251
169930,0watchdog/10-21swapper/121:10:291
169930,0watchdog/10-21swapper/119:30:221
169930,0watchdog/10-21swapper/118:55:301
29594220,0sleep30-21swapper/319:10:173
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional