You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-13 - 08:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Mon Jul 13, 2026 00:44:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1243412995448,4cyclictest1260734-21kworker/u8:1+events_unbound20:01:321
1243411995123,3cyclictest0-21swapper/020:45:010
1243425994919,26cyclictest0-21swapper/322:05:253
1243411994939,7cyclictest1322850-21grep22:59:590
1243417994734,10cyclictest311ktimers/223:40:142
1243412994435,5cyclictest1273179-21munin-plugin-st20:35:011
1243412994431,9cyclictest1261233-21latency_hist20:00:001
1243412994431,9cyclictest1261233-21latency_hist20:00:001
1243425994315,24cyclictest0-21swapper/323:40:263
1243425994231,7cyclictest1260596-21grep19:55:283
1243425994231,7cyclictest1260596-21grep19:55:283
1243425994210,3cyclictest0-21swapper/320:00:123
1243412994232,6cyclictest1291938-21cron21:30:001
1243411994233,6cyclictest1301953-21unixbench_singl21:55:270
1243411994233,6cyclictest1260599-21unixbench_singl19:55:280
1243411994233,6cyclictest1260599-21unixbench_singl19:55:280
1243411994229,10cyclictest121ktimers/023:45:110
1243425994130,7cyclictest1301950-21grep21:55:273
1243425994125,13cyclictest0-21swapper/300:15:003
1243425994115,22cyclictest0-21swapper/320:35:263
1243425994113,3cyclictest0-21swapper/320:55:283
124342599411,10cyclictest1309643-21fschecks_time22:20:173
1243412994131,6cyclictest1352279-21auditctl00:25:001
1243412994129,9cyclictest1329902-21sendmail23:20:001
124342599407,7cyclictest1323282-21gdbus23:00:013
1243425994029,6cyclictest0-21swapper/300:19:593
1243425994013,2cyclictest0-21swapper/320:16:373
1243425994011,3cyclictest0-21swapper/320:30:123
1243412994030,6cyclictest1317735-21cron22:45:011
124342599396,7cyclictest1354071-21cat00:30:013
1243425993911,4cyclictest0-21swapper/320:40:173
124342599391,13cyclictest1306666-21/usr/sbin/munin22:10:243
124342599390,10cyclictest1252477-21cron19:35:013
1243417993930,5cyclictest311ktimers/223:20:122
124342599387,5cyclictest0-21swapper/319:20:173
1243425993828,6cyclictest0-21swapper/322:59:593
124342599381,7cyclictest1255447-21grep19:40:263
1243425993811,3cyclictest0-21swapper/319:13:383
124342599381,11cyclictest1291357-21wc21:25:253
124342599381,10cyclictest1355211-21unixbench_multi00:30:263
1243417993830,5cyclictest1329458-21unixbench_singl23:15:272
1243425993727,6cyclictest0-21swapper/321:25:013
1243425993724,8cyclictest0-21swapper/322:15:233
1243425993712,3cyclictest0-21swapper/319:25:253
124342599371,10cyclictest1317269-21grep22:40:253
124342599371,10cyclictest1271476-21munin-plugin-st20:30:013
1243425993710,3cyclictest0-21swapper/321:41:473
1243412993727,5cyclictest131rcu_preempt21:50:131
1243412993725,6cyclictest1334860-21kworker/u8:1+events_unbound23:47:321
1243412993710,4cyclictest131rcu_preempt21:30:131
1243425993613,3cyclictest1342266-21/usr/sbin/munin23:55:163
1243425993613,3cyclictest0-21swapper/320:05:273
1243425993612,3cyclictest0-21swapper/320:45:193
1243425993612,3cyclictest0-21swapper/320:45:193
1243425993612,21cyclictest0-21swapper/322:25:153
1243417993626,6cyclictest0-21swapper/222:55:262
1243412993626,7cyclictest1254214-21idleruntime-cro19:40:011
1243412993626,6cyclictest0-21swapper/123:00:001
1243412993626,5cyclictest0-21swapper/119:35:001
1243412993615,6cyclictest131rcu_preempt21:15:131
1243412993610,4cyclictest131rcu_preempt22:10:141
1243411993629,4cyclictest1254210-21sendmail19:40:000
124342599359,4cyclictest1340362-21latency_hist23:50:013
1243425993526,7cyclictest391ktimers/319:45:103
1243425993526,6cyclictest1342025-21cron23:55:003
124342599351,8cyclictest1288530-21cron21:20:003
1243425993514,3cyclictest1335812-21sh23:35:243
1243425993514,18cyclictest645-21runrttasks23:30:193
1243425993513,3cyclictest1243409-21cyclictest20:50:243
1243425993513,3cyclictest1243409-21cyclictest20:50:243
124342599351,10cyclictest1345446-21cron00:05:013
124342599351,10cyclictest1258889-21grep19:50:273
1243417993529,4cyclictest1261156-21latency_hist20:00:012
1243417993529,4cyclictest1261156-21latency_hist20:00:012
1243412993529,4cyclictest1257261-21kworker/u8:0+events_unbound19:46:301
1243412993525,7cyclictest1303664-21unixbench_singl22:00:261
1243412993523,9cyclictest231ktimers/100:30:131
1243412993516,5cyclictest131rcu_preempt23:05:121
1243411993528,4cyclictest1288529-21latency_hist21:20:010
1243425993425,5cyclictest1314334-21cut22:35:003
124342599341,9cyclictest1357406-21tr00:39:593
1243425993411,3cyclictest1292284-21df21:30:153
124342599341,10cyclictest1346693-21unixbench_multi00:05:263
1243417993426,4cyclictest0-21swapper/222:30:172
1243417993424,7cyclictest1336719-21sendmail23:40:002
1243412993426,5cyclictest1271460-21cron20:30:011
1243412993423,7cyclictest1338227-21chrt23:40:251
1243411993425,5cyclictest0-21swapper/021:05:000
1243411993423,6cyclictest0-21swapper/022:15:230
124342599331,11cyclictest1326467-21cron23:10:013
124342599331,11cyclictest1247358-21cron19:20:003
1243412993325,4cyclictest0-21swapper/122:15:131
1243412993325,4cyclictest0-21swapper/120:45:171
1243412993325,4cyclictest0-21swapper/120:45:171
1243412993324,5cyclictest1356922-21unixbench_multi00:35:261
1243412993324,5cyclictest0-21swapper/121:55:261
1243411993327,4cyclictest1347161-21munin-plugin-st00:10:010
1243425993224,4cyclictest0-21swapper/322:40:013
1243425993222,6cyclictest0-21swapper/322:00:243
1243425993210,3cyclictest0-21swapper/322:55:013
1243417993225,3cyclictest0-21swapper/200:05:162
1243417993224,5cyclictest311ktimers/221:00:092
1243417993222,6cyclictest0-21swapper/221:05:272
1243412993223,5cyclictest1274887-21idleruntime-cro20:40:011
1243412993222,5cyclictest0-21swapper/100:03:091
1243412993217,5cyclictest1324398-21kworker/u8:0+events_unbound23:04:421
1243411993225,5cyclictest199-21systemd-network22:30:230
1243425993123,5cyclictest0-21swapper/321:40:003
1243425993119,6cyclictest0-21swapper/321:05:273
1243417993125,4cyclictest1269954-21latency_hist20:25:022
1243417993124,4cyclictest0-21swapper/223:45:262
1243417993124,3cyclictest0-21swapper/200:30:262
1243417993123,4cyclictest0-21swapper/219:15:262
1243417993122,5cyclictest1262514-21grep20:00:242
1243412993124,4cyclictest0-21swapper/122:25:241
1243411993123,5cyclictest0-21swapper/019:15:000
1243411993121,6cyclictest0-21swapper/023:30:280
1243417993023,5cyclictest1281613-21kworker/u8:0+events_unbound21:11:442
1243417993023,3cyclictest0-21swapper/200:00:312
1243412993024,3cyclictest1353985-21kthreadd00:29:591
1243412993019,8cyclictest1285110-21cron21:10:001
1243411993023,4cyclictest1305693-21kworker/u8:3+events_unbound22:21:510
1243411993022,5cyclictest1293228-21grep21:30:250
1243411993019,7cyclictest0-21swapper/023:40:000
1243417992922,5cyclictest1269755-21kworker/u8:1+events_unbound20:31:352
1243417992922,4cyclictest0-21swapper/220:10:272
1243417992921,6cyclictest1352232-21kworker/u8:2+events_unbound00:28:352
1243417992921,4cyclictest0-21swapper/222:40:152
1243417992921,4cyclictest0-21swapper/200:00:002
1243412992922,5cyclictest1326946-21kworker/u8:3+events_unbound23:32:101
1243412992921,4cyclictest0-21swapper/119:40:271
1243411992922,3cyclictest0-21swapper/020:25:020
1243411992920,6cyclictest0-21swapper/022:50:240
1243425992820,4cyclictest0-21swapper/323:15:273
1243425992810,5cyclictest391ktimers/319:35:133
1243417992820,4cyclictest0-21swapper/223:30:012
1243417992820,4cyclictest0-21swapper/219:10:282
124341299289,7cyclictest131rcu_preempt21:35:121
1243412992822,4cyclictest1340291-21kworker/u8:0+events_unbound00:10:191
1243412992822,4cyclictest1281613-21kworker/u8:0+events_unbound21:01:351
1243412992817,9cyclictest629-21snmpd21:20:121
1243412992814,10cyclictest1268069-21tr20:20:011
1243411992822,3cyclictest13850irq/36-mmc100:00:010
1243411992822,3cyclictest0-21swapper/023:45:000
1243411992822,3cyclictest0-21swapper/022:40:010
1243411992820,5cyclictest0-21swapper/021:55:010
1243411992820,4cyclictest0-21swapper/023:20:250
1243411992819,4cyclictest0-21swapper/022:25:230
1243411992817,8cyclictest1341563-21grep23:50:250
1243411992817,7cyclictest1248624-21tail19:20:270
1243425992720,3cyclictest0-21swapper/320:10:283
1243425992717,6cyclictest1283423-21grep21:05:003
1243425992716,8cyclictest1300707-21sed21:55:013
1243425992710,4cyclictest391ktimers/322:45:243
1243417992721,3cyclictest0-21swapper/219:35:262
1243417992720,4cyclictest0-21swapper/223:10:262
1243417992718,7cyclictest311ktimers/220:35:132
1243417992718,6cyclictest1342026-21cron23:55:012
1243417992718,6cyclictest1250924-21latency_hist19:30:002
1243417992718,5cyclictest0-21swapper/219:25:002
1243412992720,5cyclictest1262757-21kworker/u8:2+events_unbound20:11:401
1243412992720,4cyclictest0-21swapper/122:35:171
1243412992719,5cyclictest1247939-21mii-tool19:20:181
1243412992715,8cyclictest231ktimers/123:55:121
1243417992620,3cyclictest0-21swapper/222:30:012
124341299268,11cyclictest0-21swapper/123:24:431
1243412992620,3cyclictest0-21swapper/122:45:151
1243412992619,5cyclictest1346792-21kworker/u8:2+events_unbound00:15:181
1243412992619,5cyclictest1280376-21fschecks_count20:55:181
1243412992618,6cyclictest1326946-21kworker/u8:3+events_unbound23:25:201
1243412992618,4cyclictest0-21swapper/121:45:011
1243412992612,8cyclictest231ktimers/122:30:121
124341299261,13cyclictest0-21swapper/122:22:441
124341299261,12cyclictest0-21swapper/119:51:291
124341199265,19cyclictest0-21swapper/021:20:220
124341199262,20cyclictest1330000-21wc23:20:010
1243411992620,4cyclictest1284838-21kworker/u8:1+events_unbound21:08:420
1243411992618,4cyclictest1304098-21sh22:05:000
1243411992617,6cyclictest0-21swapper/019:40:260
1243425992519,3cyclictest0-21swapper/321:50:013
1243425992518,4cyclictest0-21swapper/300:20:163
1243417992519,3cyclictest0-21swapper/222:15:142
1243417992518,4cyclictest1310919-21sh22:25:012
1243417992518,4cyclictest0-21swapper/221:35:162
1243417992517,4cyclictest0-21swapper/222:00:252
1243417992515,6cyclictest0-21swapper/220:20:002
1243417992514,8cyclictest1281051-21cat20:55:262
1243417992512,3cyclictest131rcu_preempt00:35:122
124341299253,12cyclictest1238403-1kworker/1:0H19:10:071
1243412992518,5cyclictest1242928-21kworker/u8:2+events_unbound19:28:041
124341299251,12cyclictest0-21swapper/119:17:111
124341299250,3cyclictest0-21swapper/123:10:141
124341199252,19cyclictest0-21swapper/020:36:080
1243411992519,4cyclictest13550irq/42-30be0000.ethernet23:25:120
1243411992519,3cyclictest0-21swapper/021:10:160
1243411992518,3cyclictest0-21swapper/023:00:170
1243411992516,6cyclictest0-21swapper/020:50:210
1243411992516,6cyclictest0-21swapper/020:50:200
1243411992516,4cyclictest0-21swapper/020:31:340
1243411992515,7cyclictest1265407-21ntpq20:10:230
1243411992515,6cyclictest13550irq/42-30be0000.ethernet22:05:210
124341199251,20cyclictest0-21swapper/023:11:480
124341199251,20cyclictest0-21swapper/020:17:280
1243425992418,3cyclictest0-21swapper/323:25:013
1243425992415,6cyclictest0-21swapper/323:10:273
1243417992416,6cyclictest1269755-21kworker/u8:1+events_unbound20:51:422
1243417992416,6cyclictest1269755-21kworker/u8:1+events_unbound20:51:422
1243417992416,4cyclictest0-21swapper/222:50:002
1243417992416,4cyclictest0-21swapper/221:50:172
1243417992415,5cyclictest0-21swapper/220:41:352
1243417992414,6cyclictest0-21swapper/222:50:132
1243412992418,3cyclictest0-21swapper/120:50:261
1243412992418,3cyclictest0-21swapper/120:50:261
124341299241,7cyclictest0-21swapper/122:50:121
1243412992417,5cyclictest1264491-21kworker/u8:0+events_unbound20:21:011
1243412992417,5cyclictest1264491-21kworker/u8:0+events_unbound20:09:331
1243412992417,3cyclictest0-21swapper/123:35:171
1243412992416,5cyclictest1269755-21kworker/u8:1+events_unbound20:40:201
1243412992410,3cyclictest0-21swapper/121:10:151
1243411992417,3cyclictest0-21swapper/019:31:470
124341199241,21cyclictest0-21swapper/000:00:160
124341199241,19cyclictest0-21swapper/022:49:210
124341199241,19cyclictest0-21swapper/000:12:110
124341199240,22cyclictest0-21swapper/020:45:250
124341199240,22cyclictest0-21swapper/020:45:250
1243425992317,3cyclictest0-21swapper/323:25:153
1243417992317,3cyclictest0-21swapper/223:30:262
1243417992317,3cyclictest0-21swapper/220:45:172
1243417992317,3cyclictest0-21swapper/220:45:172
1243417992316,5cyclictest0-21swapper/200:15:122
1243417992316,4cyclictest1291953-21munin-plugin-st21:30:012
1243417992316,4cyclictest0-21swapper/221:55:262
1243417992314,6cyclictest0-21swapper/219:30:192
1243417992312,9cyclictest1263741-21ntp_states20:05:232
1243412992313,4cyclictest1297043-21kworker/u8:0+events_unbound21:46:481
1243411992318,3cyclictest0-21swapper/000:20:130
1243411992316,3cyclictest0-21swapper/000:30:250
1243411992315,5cyclictest0-21swapper/022:10:170
1243411992314,5cyclictest0-21swapper/000:39:490
1243411992313,7cyclictest1250066-21mailstats19:25:250
124341199231,20cyclictest0-21swapper/021:38:350
124341199231,19cyclictest0-21swapper/019:47:000
124341199231,18cyclictest0-21swapper/020:57:150
124341199231,18cyclictest0-21swapper/000:16:450
124341199230,19cyclictest0-21swapper/020:27:560
124341199230,19cyclictest0-21swapper/020:03:260
1243425992216,3cyclictest0-21swapper/320:20:223
1243417992216,3cyclictest0-21swapper/221:20:012
1243412992214,4cyclictest0-21swapper/100:05:251
1243411992217,3cyclictest0-21swapper/021:41:570
124341199221,3cyclictest0-21swapper/022:41:540
124341199221,19cyclictest0-21swapper/020:09:400
1243425992114,4cyclictest0-21swapper/321:10:273
1243417992115,3cyclictest0-21swapper/222:35:142
1243417992115,3cyclictest0-21swapper/200:20:172
1243417992115,3cyclictest0-21swapper/200:10:252
1243417992114,5cyclictest0-21swapper/221:30:212
1243417992110,8cyclictest1323542-21fw_packets23:00:172
1243417992110,8cyclictest1289741-21cat21:20:242
1243412992115,3cyclictest0-21swapper/123:50:151
1243411992113,5cyclictest1352512-21apt-get00:25:120
124341199210,17cyclictest0-21swapper/023:09:340
124341799207,10cyclictest311ktimers/221:40:122
1243417992014,4cyclictest311ktimers/221:45:112
1243417992014,4cyclictest1256350-21fschecks_time19:45:152
1243417992014,3cyclictest0-21swapper/222:05:152
1243417992013,5cyclictest311ktimers/223:05:122
1243417992013,5cyclictest311ktimers/222:10:132
1243417992012,5cyclictest0-21swapper/219:40:192
1243417992010,7cyclictest1270478-21sed20:25:202
1243411992013,4cyclictest0-21swapper/021:25:250
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional