You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-10 - 06:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Wed Jun 10, 2026 00:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1802992621,4cyclictest0-21swapper/200:14:462
1796992522,2cyclictest15431-21tail21:29:211
179699250,24cyclictest0-21swapper/122:31:071
1793992523,1cyclictest0-21swapper/021:45:230
179399250,24cyclictest0-21swapper/023:38:220
1808992424,0cyclictest28189-21diskmemload00:33:373
180899240,24cyclictest0-21swapper/300:18:293
180899240,23cyclictest8135-21ssh21:22:143
180899240,23cyclictest28189-21diskmemload22:11:563
180899240,23cyclictest19514-21sh22:34:023
1802992422,1cyclictest13708-21ssh22:58:222
1802992422,0cyclictest0-21swapper/221:41:032
1802992420,3cyclictest9879-21df21:54:212
180299240,24cyclictest0-21swapper/221:37:502
180299240,23cyclictest29636-21ssh22:12:292
180299240,23cyclictest28189-21diskmemload21:25:522
180299240,23cyclictest0-21swapper/221:48:432
180299240,23cyclictest0-21swapper/219:59:182
1796992424,0cyclictest0-21swapper/123:45:261
1796992422,1cyclictest20954-21idleruntime-cro00:05:011
1796992422,1cyclictest0-21swapper/100:34:271
179699240,24cyclictest0-21swapper/121:59:541
179699240,23cyclictest28189-21diskmemload22:45:331
179699240,23cyclictest0-21swapper/121:50:271
179699240,23cyclictest0-21swapper/121:47:081
179699240,0cyclictest0-21swapper/123:34:301
179699240,0cyclictest0-21swapper/123:23:211
1793992423,1cyclictest62550irq/127-eno122:10:330
1793992423,0cyclictest0-21swapper/021:42:320
1793992422,2cyclictest0-21swapper/023:50:070
179399242,21cyclictest28189-21diskmemload00:14:400
1793992422,1cyclictest0-21swapper/022:27:150
1793992422,1cyclictest0-21swapper/022:00:190
179399242,1cyclictest7137-21sh21:20:450
179399240,23cyclictest0-21swapper/023:56:130
179399240,23cyclictest0-21swapper/021:36:010
179399240,0cyclictest28189-21diskmemload22:30:340
179399240,0cyclictest28189-21diskmemload00:38:530
179399240,0cyclictest28189-21diskmemload00:27:140
179399240,0cyclictest0-21swapper/000:22:120
1808992323,0cyclictest0-21swapper/323:02:313
1808992323,0cyclictest0-21swapper/322:47:233
1808992323,0cyclictest0-21swapper/300:37:563
1808992322,1cyclictest28642-21ssh23:42:383
180899230,23cyclictest26756-21apt-get20:04:183
180899230,23cyclictest0-21swapper/322:03:403
180899230,23cyclictest0-21swapper/300:02:063
180899230,22cyclictest6080-21ssh21:19:313
180899230,22cyclictest19667-21rm21:33:033
180899230,22cyclictest16763-21ssh23:30:453
180899230,22cyclictest10282-21sh00:25:173
180899230,0cyclictest28189-21diskmemload23:07:033
180899230,0cyclictest28189-21diskmemload22:22:483
180899230,0cyclictest0-21swapper/322:18:463
180899230,0cyclictest0-21swapper/321:35:363
180899230,0cyclictest0-21swapper/320:35:003
1802992321,2cyclictest28-21ksoftirqd/220:44:182
1802992321,1cyclictest26039-21apt-get21:05:022
1802992320,2cyclictest23952-21rm00:09:092
180299230,23cyclictest28189-21diskmemload21:15:382
180299230,23cyclictest28189-21diskmemload00:39:092
180299230,23cyclictest0-21swapper/223:50:462
180299230,23cyclictest0-21swapper/223:28:262
180299230,23cyclictest0-21swapper/223:15:532
180299230,23cyclictest0-21swapper/200:31:522
180299230,22cyclictest25422-21wc21:05:002
180299230,22cyclictest19754-21ssh22:03:472
180299230,22cyclictest19281-21ssh22:33:432
180299230,22cyclictest16905-21ssh23:00:052
180299230,0cyclictest0-21swapper/223:41:312
180299230,0cyclictest0-21swapper/221:55:242
180299230,0cyclictest0-21swapper/200:27:582
180299230,0cyclictest0-21swapper/200:24:082
180299230,0cyclictest0-21swapper/200:18:282
180299230,0cyclictest0-21swapper/200:03:032
1796992323,0cyclictest0-21swapper/123:10:241
1796992323,0cyclictest0-21swapper/123:02:471
1796992323,0cyclictest0-21swapper/122:22:421
1796992321,1cyclictest0-21swapper/122:56:381
1796992321,1cyclictest0-21swapper/119:45:001
1796992321,1cyclictest0-21swapper/100:38:121
1796992321,1cyclictest0-21swapper/100:16:321
1796992320,2cyclictest6996-21sh23:52:471
1796992320,2cyclictest15331-21sh23:59:401
179699230,2cyclictest17802-21sh22:00:481
179699230,23cyclictest0-21swapper/122:40:361
179699230,22cyclictest28154-21sh00:12:361
179699230,22cyclictest25031-21rm21:38:051
179699230,22cyclictest21771-21rm23:35:101
179699230,22cyclictest16160-21apt19:40:001
179699230,22cyclictest15830-21grep20:45:011
179699230,22cyclictest0-21swapper/122:38:331
179699230,22cyclictest0-21swapper/121:16:151
179699230,22cyclictest0-21swapper/121:14:561
179699230,22cyclictest0-21swapper/100:09:011
179699230,1cyclictest0-21swapper/123:05:541
179699230,1cyclictest0-21swapper/122:26:351
179699230,0cyclictest0-21swapper/123:42:291
179699230,0cyclictest0-21swapper/122:53:191
179699230,0cyclictest0-21swapper/121:33:291
1793992323,0cyclictest0-21swapper/022:43:460
1793992323,0cyclictest0-21swapper/022:18:060
1793992323,0cyclictest0-21swapper/021:29:120
1793992323,0cyclictest0-21swapper/000:05:160
1793992322,1cyclictest62550irq/127-eno123:09:440
1793992322,1cyclictest18495-21diskmemload23:02:370
1793992322,1cyclictest0-21swapper/000:30:230
1793992321,2cyclictest0-21swapper/023:11:060
1793992321,1cyclictest6506-21ssh22:20:250
1793992321,1cyclictest21553-21apt-get19:54:180
1793992321,1cyclictest0-21swapper/021:31:580
179399230,23cyclictest28189-21diskmemload23:17:580
179399230,23cyclictest0-21swapper/022:55:350
179399230,22cyclictest29051-21diskmemload23:43:140
179399230,22cyclictest10093-21ssh22:54:250
179399230,1cyclictest18225-21munin-run20:50:010
179399230,0cyclictest28189-21diskmemload22:05:550
179399230,0cyclictest0-21swapper/000:00:570
1808992222,0cyclictest0-21swapper/323:52:063
1808992222,0cyclictest0-21swapper/323:20:343
1808992222,0cyclictest0-21swapper/323:16:313
1808992222,0cyclictest0-21swapper/321:42:543
1808992221,1cyclictest4893-21rm00:20:113
1808992220,1cyclictest13423-21perf20:40:003
1808992220,1cyclictest11352-21latency_hist19:30:003
180899220,22cyclictest28189-21diskmemload22:55:143
180899220,22cyclictest0-21swapper/321:45:253
180899220,22cyclictest0-21swapper/300:13:163
180899220,21cyclictest605-21avahi-daemon23:30:003
180899220,21cyclictest21874-21ssh00:06:113
180899220,21cyclictest1305-21ssh23:47:093
180899220,21cyclictest11989-21sh21:55:123
180899220,21cyclictest0-21swapper/322:35:223
180899220,21cyclictest0-21swapper/322:27:093
180899220,21cyclictest0-21swapper/320:10:023
180899220,21cyclictest0-21swapper/319:24:173
180899220,1cyclictest30960-21apt20:10:013
180899220,1cyclictest29716-21ssh22:42:453
180899220,1cyclictest12885-21ssh23:58:343
180899220,1cyclictest12112-21ssh21:25:133
180899220,0cyclictest0-21swapper/323:35:183
180899220,0cyclictest0-21swapper/321:12:473
1802992222,0cyclictest0-21swapper/223:59:142
1802992222,0cyclictest0-21swapper/223:13:252
1802992220,2cyclictest7966-21ssh22:22:372
1802992220,1cyclictest28946-21sh21:10:512
1802992219,2cyclictest6183-21cron20:25:002
180299220,22cyclictest0-21swapper/223:20:072
180299220,21cyclictest609-21rs:main2
180299220,21cyclictest4510-21users23:49:292
180299220,21cyclictest11989-21rm22:25:392
180299220,21cyclictest0-21swapper/223:35:012
180299220,21cyclictest0-21swapper/222:35:112
180299220,21cyclictest0-21swapper/222:15:062
180299220,1cyclictest28727-21ssh22:41:222
180299220,1cyclictest23220-21ssh23:06:412
180299220,0cyclictest0-21swapper/222:09:332
1796992222,0cyclictest28189-21diskmemload21:40:311
1796992222,0cyclictest0-21swapper/122:16:391
1796992222,0cyclictest0-21swapper/120:34:201
1796992222,0cyclictest0-21swapper/100:25:211
1796992221,1cyclictest6999-21ssh21:20:321
1796992221,1cyclictest0-21swapper/120:14:161
1796992221,0cyclictest0-21swapper/120:19:181
1796992220,1cyclictest6573-21munin-plugin-st19:20:011
1796992220,1cyclictest2339-21apt-get19:14:181
1796992220,1cyclictest23016-21sendmail21:00:011
179699220,21cyclictest1716-21diskmemload23:17:101
179699220,21cyclictest0-21swapper/122:10:451
179699220,21cyclictest0-21swapper/122:05:181
179699220,21cyclictest0-21swapper/100:20:071
179699220,0cyclictest0-21swapper/119:34:201
1793992222,0cyclictest28189-21diskmemload21:55:270
1793992222,0cyclictest0-21swapper/022:35:120
1793992222,0cyclictest0-21swapper/021:50:220
1793992222,0cyclictest0-21swapper/021:15:410
1793992221,0cyclictest14011-21apt-get20:44:180
1793992220,1cyclictest16167-21perf19:40:000
1793992220,1cyclictest0-21swapper/023:25:340
179399220,21cyclictest25408-21turbostat.cron21:05:000
179399220,21cyclictest23030-21sendmail-msp21:00:010
179399220,21cyclictest0-21swapper/020:29:200
179399220,1cyclictest17021-21ssh23:31:060
179399220,1cyclictest0-21swapper/023:22:540
179399220,1cyclictest0-21swapper/022:46:270
179399220,1cyclictest0-21swapper/000:16:440
179399220,0cyclictest28189-21diskmemload21:12:220
1808992120,1cyclictest6613-21ssh21:50:043
1808992120,1cyclictest6209-21ssh22:50:023
180899210,21cyclictest28189-21diskmemload23:13:073
180899210,21cyclictest0-21swapper/319:14:183
1802992121,0cyclictest0-21swapper/222:47:392
1802992120,1cyclictest6763-21rm21:20:052
1802992120,1cyclictest16407-21apt-get20:49:192
180299210,0cyclictest28189-21diskmemload22:50:012
179699210,21cyclictest0-21swapper/119:54:181
179699210,1cyclictest20612-21wc20:55:011
179699210,0cyclictest25404-21apt-get21:05:011
1793992119,1cyclictest28560-21dump-pmu-power20:05:010
179399210,1cyclictest24340-21apt-get19:59:180
179399210,0cyclictest0-21swapper/020:24:180
179399210,0cyclictest0-21swapper/019:44:190
1808992020,0cyclictest18803-21apt-get20:54:193
1808992017,2cyclictest28211-21awk21:10:003
180899200,20cyclictest0-21swapper/319:35:003
1802992020,0cyclictest0-21swapper/220:29:192
1802992020,0cyclictest0-21swapper/220:19:182
1802992020,0cyclictest0-21swapper/219:54:182
1802992020,0cyclictest0-21swapper/219:49:182
1802992019,1cyclictest4739-21apt-get19:19:202
1802992019,1cyclictest0-21swapper/220:04:172
180299200,20cyclictest0-21swapper/220:10:022
180299200,0cyclictest9198-21apt-get20:34:202
180299200,0cyclictest0-21swapper/220:59:192
1796992018,1cyclictest606-21dbus-daemon20:00:011
1796992018,1cyclictest13408-21sendmail-msp20:40:001
179699200,20cyclictest0-21swapper/120:24:181
1793992020,0cyclictest31940-21apt-get20:14:160
179399200,0cyclictest0-21swapper/020:34:200
179399200,0cyclictest0-21swapper/019:34:200
1808991919,0cyclictest0-21swapper/320:49:193
1808991919,0cyclictest0-21swapper/319:59:183
1802991919,0cyclictest0-21swapper/219:34:202
1802991919,0cyclictest0-21swapper/219:29:182
1802991919,0cyclictest0-21swapper/219:24:172
1796991919,0cyclictest0-21swapper/121:04:201
1796991919,0cyclictest0-21swapper/119:49:171
1796991919,0cyclictest0-21swapper/119:29:191
1793991918,0cyclictest0-21swapper/019:14:180
1808991818,0cyclictest0-21swapper/320:44:183
1808991818,0cyclictest0-21swapper/319:54:183
1802991818,0cyclictest0-21swapper/219:44:192
1802991818,0cyclictest0-21swapper/219:40:002
1796991818,0cyclictest0-21swapper/120:29:191
1796991818,0cyclictest0-21swapper/120:04:181
1793991818,0cyclictest0-21swapper/020:54:190
1793991818,0cyclictest0-21swapper/020:39:180
1793991816,1cyclictest1990-21apt-get20:19:190
179399180,0cyclictest7152-21apt-get19:24:170
1808991717,0cyclictest21200-21apt-get20:59:193
1793991717,0cyclictest0-21swapper/021:09:180
1808991616,0cyclictest0-21swapper/321:04:203
1802991616,0cyclictest0-21swapper/220:39:192
1802991614,1cyclictest20524-21users20:54:282
1793991616,0cyclictest0-21swapper/019:49:180
1793991614,1cyclictest0-21swapper/020:10:010
1808991515,0cyclictest0-21swapper/319:39:193
1793991515,0cyclictest0-21swapper/019:29:190
1808991414,0cyclictest0-21swapper/320:20:473
180899140,14cyclictest0-21swapper/320:25:513
180899140,14cyclictest0-21swapper/320:15:153
180899140,14cyclictest0-21swapper/319:41:283
180899140,14cyclictest0-21swapper/319:16:303
180899140,0cyclictest0-21swapper/319:45:403
180299140,14cyclictest0-21swapper/220:05:172
1796991414,0cyclictest0-21swapper/119:20:511
1793991414,0cyclictest0-21swapper/019:15:230
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional