You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-09 - 00:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sat Aug 08, 2026 12:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3033899260,25cyclictest24964-21sh09:10:193
30326992623,2cyclictest21286-21sh11:03:090
3032699260,25cyclictest20339-21apt-get09:04:140
30338992523,1cyclictest0-21swapper/311:34:123
30334992521,2cyclictest20785-21needreboot10:04:162
3033499250,0cyclictest0-21swapper/211:43:112
30330992525,0cyclictest22-21ksoftirqd/111:11:481
30330992523,1cyclictest0-21swapper/112:16:271
3033099250,24cyclictest1597-21sh10:15:441
3033099250,1cyclictest29601-21ssh10:12:271
3032699250,24cyclictest24529-21diskmemload10:22:590
3032699250,24cyclictest0-21swapper/010:03:550
30338992423,1cyclictest24529-21diskmemload12:02:523
30338992423,1cyclictest24529-21diskmemload12:02:523
30338992421,2cyclictest783-21snmpd11:19:273
30338992421,2cyclictest18036-21ssh10:30:213
3033899240,23cyclictest24529-21diskmemload09:45:023
3033899240,23cyclictest0-21swapper/309:58:253
3033899240,0cyclictest24529-21diskmemload11:05:233
3033899240,0cyclictest24529-21diskmemload10:01:023
3033899240,0cyclictest0-21swapper/312:24:513
3033499243,20cyclictest28-21ksoftirqd/209:26:272
30334992423,1cyclictest24529-21diskmemload09:13:482
30334992422,1cyclictest28-21ksoftirqd/207:40:002
30334992422,1cyclictest0-21swapper/211:20:592
30334992422,1cyclictest0-21swapper/210:49:252
30334992422,1cyclictest0-21swapper/209:44:142
3033499240,23cyclictest0-21swapper/209:35:442
3033499240,23cyclictest0-21swapper/209:30:152
30330992423,0cyclictest20419-21ssh10:33:421
3033099240,23cyclictest0-21swapper/111:08:231
3033099240,1cyclictest0-21swapper/112:28:461
3033099240,0cyclictest0-21swapper/110:35:471
30326992422,1cyclictest24529-21diskmemload12:19:190
30326992421,2cyclictest313-21systemd-journal10:40:010
30326992421,2cyclictest20136-21sh11:30:100
30326992421,2cyclictest0-21swapper/009:11:170
3032699241,22cyclictest3260-21ssh10:46:310
3032699241,22cyclictest30615-21grep12:09:170
3032699240,24cyclictest24529-21diskmemload10:31:540
3032699240,24cyclictest0-21swapper/012:28:190
3032699240,23cyclictest14137-21ssh10:27:400
30338992323,0cyclictest0-21swapper/310:45:453
30338992323,0cyclictest0-21swapper/310:20:083
30338992323,0cyclictest0-21swapper/309:53:533
30338992322,1cyclictest28129-21ssh12:06:283
30338992322,1cyclictest24529-21diskmemload12:11:363
30338992322,1cyclictest0-21swapper/311:59:343
30338992320,2cyclictest23999-21sh12:31:323
3033899230,23cyclictest0-21swapper/310:53:093
3033899230,23cyclictest0-21swapper/309:26:023
3033899230,22cyclictest28279-21apt-get12:35:023
3033899230,22cyclictest27541-21sh10:10:003
3033899230,22cyclictest26994-21sh11:36:553
3033899230,22cyclictest26352-21rm09:40:093
3033899230,22cyclictest2263-21rm09:19:163
3033899230,22cyclictest18622-21apt-get07:54:123
3033899230,22cyclictest17644-21grep10:59:223
3033899230,22cyclictest11693-21munin-run12:20:013
3033899230,22cyclictest10544-21sh11:50:453
3033899230,22cyclictest0-21swapper/309:39:133
3033899230,0cyclictest24529-21diskmemload09:31:323
3033899230,0cyclictest0-21swapper/310:10:403
30334992323,0cyclictest24529-21diskmemload12:06:032
30334992323,0cyclictest24529-21diskmemload11:02:512
30334992323,0cyclictest24529-21diskmemload10:25:322
30334992323,0cyclictest24529-21diskmemload09:17:152
30334992323,0cyclictest0-21swapper/210:24:582
30334992323,0cyclictest0-21swapper/210:11:422
30334992323,0cyclictest0-21swapper/209:48:332
30334992321,1cyclictest151rcu_preempt09:59:132
30334992320,2cyclictest24109-21rm10:36:002
30334992319,4cyclictest0-21swapper/210:55:292
3033499230,22cyclictest24580-21ssh11:05:042
3033499230,22cyclictest24529-21diskmemload11:48:572
3033499230,22cyclictest22455-21ssh12:29:472
3033499230,22cyclictest22232-21ssh10:05:012
3033499230,22cyclictest20310-21rm10:33:332
3033499230,22cyclictest15447-21ssh11:26:202
3033499230,22cyclictest0-21swapper/210:41:022
3033499230,0cyclictest0-21swapper/212:23:282
3033499230,0cyclictest0-21swapper/212:16:472
30330992323,0cyclictest24529-21diskmemload12:32:091
30330992323,0cyclictest0-21swapper/112:05:271
30330992323,0cyclictest0-21swapper/111:34:141
30330992323,0cyclictest0-21swapper/110:40:411
30330992323,0cyclictest0-21swapper/110:20:081
30330992323,0cyclictest0-21swapper/109:48:321
30330992321,1cyclictest28254-21ssh09:42:511
30330992321,1cyclictest211rcuc/108:00:001
30330992321,1cyclictest0-21swapper/112:04:171
30330992321,1cyclictest0-21swapper/112:04:171
30330992321,1cyclictest0-21swapper/110:26:551
30330992321,1cyclictest0-21swapper/109:12:081
30330992320,2cyclictest5338-21sh11:17:571
30330992320,2cyclictest15634-21ssh11:26:341
3033099230,2cyclictest9961-21sh09:25:391
3033099230,2cyclictest20721-21ssh11:02:271
3033099230,2cyclictest15849-21ssh11:55:251
3033099230,23cyclictest24529-21diskmemload11:47:251
3033099230,23cyclictest0-21swapper/109:24:111
3033099230,22cyclictest7365-21ssh09:53:141
3033099230,22cyclictest472-21ssh11:42:171
3033099230,22cyclictest4430-21apt-config08:29:211
3033099230,22cyclictest32649-21ssh09:17:381
3033099230,22cyclictest24529-21diskmemload10:49:161
3033099230,22cyclictest21888-21ssh09:36:471
3033099230,22cyclictest19791-21ls10:04:121
3033099230,22cyclictest15306-21idleruntime-cro11:55:001
3033099230,22cyclictest11992-21ssh12:20:211
3033099230,0cyclictest0-21swapper/111:35:271
3033099230,0cyclictest0-21swapper/110:51:511
30326992323,0cyclictest24529-21diskmemload11:35:380
30326992323,0cyclictest0-21swapper/011:43:050
30326992323,0cyclictest0-21swapper/009:22:210
30326992321,2cyclictest24529-21diskmemload10:40:210
30326992321,2cyclictest0-21swapper/011:57:160
30326992321,1cyclictest28922-21apt-get12:35:020
30326992321,1cyclictest18853-21tr11:00:000
30326992321,1cyclictest0-21swapper/012:31:150
30326992321,1cyclictest0-21swapper/010:50:010
30326992321,1cyclictest0-21swapper/007:45:000
30326992320,2cyclictest25348-21sh11:06:020
30326992319,3cyclictest5634-21sh09:50:500
3032699230,23cyclictest0-21swapper/012:13:260
3032699230,22cyclictest6323-21ssh11:47:430
3032699230,22cyclictest5932-21sh11:18:420
3032699230,22cyclictest2689-21perf07:20:010
3032699230,22cyclictest2260-21ssh09:48:570
3032699230,22cyclictest10893-21ssh11:51:110
3032699230,1cyclictest1812-21ssh10:16:090
3032699230,1cyclictest11915-21apt-get11:24:140
3032699230,0cyclictest0-21swapper/011:11:260
3032699230,0cyclictest0-21swapper/009:26:150
30338992222,0cyclictest0-21swapper/311:20:473
30338992222,0cyclictest0-21swapper/311:01:073
30338992222,0cyclictest0-21swapper/309:21:083
30338992221,0cyclictest0-21swapper/310:27:333
30338992220,1cyclictest10342-21apt-get08:44:123
30338992220,1cyclictest0-21swapper/311:49:233
30338992220,1cyclictest0-21swapper/310:36:263
3033899220,22cyclictest0-21swapper/311:10:063
3033899220,21cyclictest24529-21diskmemload11:41:583
3033899220,21cyclictest17572-21sh12:25:203
3033899220,21cyclictest0-21swapper/311:26:253
3033899220,21cyclictest0-21swapper/310:15:113
3033899220,21cyclictest0-21swapper/309:09:143
3033899220,1cyclictest0-21swapper/310:40:283
3033899220,1cyclictest0-21swapper/308:59:143
30334992221,1cyclictest24529-21diskmemload11:51:322
30334992219,2cyclictest29049-21sh12:35:212
30334992219,2cyclictest20518-21ssh11:30:392
3033499220,22cyclictest0-21swapper/212:31:152
3033499220,21cyclictest3027-21apt-get08:29:132
3033499220,21cyclictest1508-21ssh12:11:572
3033499220,21cyclictest0-21swapper/212:00:212
3033499220,21cyclictest0-21swapper/212:00:212
3033499220,21cyclictest0-21swapper/211:10:072
3033499220,21cyclictest0-21swapper/210:50:212
3033499220,21cyclictest0-21swapper/209:20:242
30330992222,0cyclictest0-21swapper/112:11:531
30330992221,1cyclictest15472-21sh10:57:521
30330992220,1cyclictest0-21swapper/109:55:251
3033099220,21cyclictest0-21swapper/111:20:181
3033099220,21cyclictest0-21swapper/110:05:101
3033099220,21cyclictest0-21swapper/108:59:141
3033099220,1cyclictest75-21kswapd012:35:021
3033099220,1cyclictest0-21swapper/109:31:541
3033099220,1cyclictest0-21swapper/108:15:011
30326992222,0cyclictest0-21swapper/011:29:290
30326992222,0cyclictest0-21swapper/009:18:010
30326992221,1cyclictest0-21swapper/012:20:360
30326992221,1cyclictest0-21swapper/009:35:080
30326992221,0cyclictest0-21swapper/008:39:130
3032699220,21cyclictest30883-21apt-get07:14:130
3032699220,21cyclictest0-21swapper/008:49:130
3032699220,1cyclictest62550irq/127-eno109:40:260
3032699220,1cyclictest19343-21apt-get09:00:010
3032699220,1cyclictest13253-21ssh09:57:590
3032699220,1cyclictest0-21swapper/010:10:430
3032699220,0cyclictest0-21swapper/010:05:070
30338992120,1cyclictest5478-21apt-get08:34:133
30338992120,0cyclictest8082-21apt-get07:34:143
30338992119,1cyclictest4398-21mailstats08:29:213
30338992119,1cyclictest32472-21munin-run08:20:013
3033499210,0cyclictest0-21swapper/209:50:342
3033499210,0cyclictest0-21swapper/207:14:132
30330992121,0cyclictest23435-21apt-get08:04:131
30330992121,0cyclictest23435-21apt-get08:04:131
30330992119,1cyclictest7872-21apt-get08:39:131
3033099210,20cyclictest0-21swapper/107:39:131
30326992120,0cyclictest0-21swapper/008:04:130
30326992120,0cyclictest0-21swapper/008:04:130
30326992120,0cyclictest0-21swapper/007:59:130
3032699210,0cyclictest0-21swapper/009:30:190
3032699210,0cyclictest0-21swapper/007:29:130
30338992020,0cyclictest0-21swapper/308:24:133
30338992020,0cyclictest0-21swapper/307:24:133
30338992019,1cyclictest16226-21apt-get07:49:133
30338992018,1cyclictest22155-21perf09:05:013
3033899200,0cyclictest0-21swapper/308:54:123
3033899200,0cyclictest0-21swapper/308:54:123
3033899200,0cyclictest0-21swapper/307:39:133
30334992020,0cyclictest0-21swapper/208:39:132
30334992018,1cyclictest25261-21idleruntime-cro08:05:012
30334992018,1cyclictest25261-21idleruntime-cro08:05:012
30334992017,2cyclictest27641-21latency_hist08:10:012
30330992020,0cyclictest0-21swapper/108:44:121
30330992020,0cyclictest0-21swapper/108:34:131
30330992019,0cyclictest25830-21apt-get08:09:131
30326992020,0cyclictest0-21swapper/007:54:120
30326992017,2cyclictest24556-21latency_hist09:10:010
3032699200,0cyclictest0-21swapper/008:54:120
3032699200,0cyclictest0-21swapper/008:54:120
3032699200,0cyclictest0-21swapper/008:29:210
30338991919,0cyclictest0-21swapper/308:09:133
30338991919,0cyclictest0-21swapper/307:40:023
30338991919,0cyclictest0-21swapper/307:14:133
30338991917,1cyclictest21017-21apt-get07:59:123
30334991919,0cyclictest0-21swapper/208:44:122
30334991917,2cyclictest28-21ksoftirqd/208:00:012
30334991917,1cyclictest9945-21perf07:35:012
30334991917,1cyclictest619-21polkitd07:30:012
3033499190,18cyclictest3288-21apt-get07:24:132
3033499190,18cyclictest20447-21latency_hist07:55:002
30330991919,0cyclictest0-21swapper/109:04:141
30330991919,0cyclictest0-21swapper/107:49:131
30330991919,0cyclictest0-21swapper/107:14:131
30326991919,0cyclictest0-21swapper/008:24:120
30326991918,0cyclictest0-21swapper/008:34:130
30338991816,1cyclictest0-21swapper/307:30:013
30334991818,0cyclictest30629-21apt-get08:19:142
30334991818,0cyclictest0-21swapper/209:00:022
30334991816,1cyclictest12831-21apt-get07:40:022
30330991818,0cyclictest0-21swapper/107:19:131
30326991816,1cyclictest606-21dbus-daemon08:45:000
30338991716,1cyclictest9772-21perf08:40:003
30338991716,0cyclictest860-21apt-get07:19:133
30334991717,0cyclictest0-21swapper/208:59:142
30334991717,0cyclictest0-21swapper/207:49:132
30330991717,0cyclictest0-21swapper/107:54:121
30330991717,0cyclictest0-21swapper/107:44:151
3033099170,12cyclictest14541-21apt08:50:001
30326991717,0cyclictest0-21swapper/008:19:140
3032699170,17cyclictest0-21swapper/007:49:200
30334991615,0cyclictest28224-21apt-get08:14:142
30334991614,1cyclictest622-21gdbus08:35:002
30334991614,1cyclictest587-21apt-get08:24:132
30334991614,1cyclictest12737-21apt-get08:49:132
30330991614,1cyclictest22733-21apt-get09:09:141
30326991616,0cyclictest0-21swapper/007:34:140
3033499150,2cyclictest0-21swapper/207:19:132
3033499150,1cyclictest0-21swapper/209:09:172
30330991515,0cyclictest0-21swapper/108:24:131
3032699150,1cyclictest28411-21grep08:14:150
3033899140,14cyclictest0-21swapper/308:45:093
3033899140,14cyclictest0-21swapper/308:12:533
3033899140,14cyclictest0-21swapper/308:00:423
3033899140,14cyclictest0-21swapper/308:00:423
3033499140,14cyclictest0-21swapper/208:52:212
3033499140,14cyclictest0-21swapper/208:52:212
30330991414,0cyclictest0-21swapper/108:16:211
3033099140,14cyclictest0-21swapper/108:50:101
3033099140,14cyclictest0-21swapper/108:50:101
3033099140,14cyclictest0-21swapper/107:25:291
3033099140,0cyclictest0-21swapper/107:30:051
3032699140,14cyclictest0-21swapper/008:06:320
3032699140,14cyclictest0-21swapper/007:21:190
3032699140,0cyclictest0-21swapper/007:36:240
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional