You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-02 - 12:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Fri May 02, 2025 00:44:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
222399160159,1cyclictest0-21swapper/219:12:352
221999140137,1cyclictest0-21swapper/119:12:351
1891211894,10sleep10-21swapper/119:08:051
18872117104,10sleep20-21swapper/219:08:012
17492115102,10sleep30-21swapper/319:06:143
29337210795,7sleep00-21swapper/019:05:150
2219999484,6cyclictest13928-21kworker/u16:2+events_unbound19:25:251
2219998366,13cyclictest13928-21kworker/u16:2+events_unbound20:25:201
2219997462,9cyclictest28187-21kworker/u16:3+events_unbound23:10:181
2219997166,3cyclictest28187-21kworker/u16:3+events_unbound21:10:181
2219997066,3cyclictest13928-21kworker/u16:2+events_unbound23:30:281
2219997064,4cyclictest13928-21kworker/u16:2+events_unbound23:50:181
2219996965,3cyclictest13928-21kworker/u16:2+events_unbound23:20:011
2219996965,3cyclictest13928-21kworker/u16:2+events_unbound22:10:031
2219996865,2cyclictest13928-21kworker/u16:2+events_unbound21:25:181
2219996763,3cyclictest3191-21kworker/u16:1+events_unbound00:00:161
106542670,0sleep00-21swapper/023:40:120
2219996559,4cyclictest28187-21kworker/u16:3+events_unbound22:00:281
213482650,1sleep0181rcuc/000:15:270
14892650,0sleep00-21swapper/020:05:170
2219996460,3cyclictest28187-21kworker/u16:3+events_unbound22:20:271
2219996460,3cyclictest28187-21kworker/u16:3+events_unbound19:20:271
2219996458,4cyclictest28187-21kworker/u16:3+events_unbound21:45:151
2219996359,3cyclictest28187-21kworker/u16:3+events_unbound22:15:141
2219996359,3cyclictest13928-21kworker/u16:2+events_unbound23:15:271
2219996359,3cyclictest13928-21kworker/u16:2+events_unbound00:20:281
2219996357,4cyclictest28187-21kworker/u16:3+events_unbound21:40:181
2219996258,3cyclictest28187-21kworker/u16:3+events_unbound22:45:271
2219996258,3cyclictest13928-21kworker/u16:2+events_unbound23:40:261
2219996258,3cyclictest13928-21kworker/u16:2+events_unbound00:10:261
2219996257,3cyclictest13928-21kworker/u16:2+events_unbound22:50:161
2219996257,3cyclictest13928-21kworker/u16:2+events_unbound00:30:161
2219996256,4cyclictest13928-21kworker/u16:2+events_unbound20:15:181
2219996056,3cyclictest13928-21kworker/u16:2+events_unbound20:55:301
2219996056,3cyclictest13928-21kworker/u16:2+events_unbound20:30:251
2219995955,3cyclictest28187-21kworker/u16:3+events_unbound21:15:261
2219995955,3cyclictest28187-21kworker/u16:3+events_unbound21:15:251
2219995955,3cyclictest13928-21kworker/u16:2+events_unbound21:05:281
2219995954,3cyclictest28187-21kworker/u16:3+events_unbound22:05:161
2219995854,3cyclictest3191-21kworker/u16:1+events_unbound23:55:251
2219995753,3cyclictest13928-21kworker/u16:2+events_unbound23:25:251
2219995753,3cyclictest13928-21kworker/u16:2+events_unbound00:05:271
2219995653,2cyclictest28187-21kworker/u16:3+events_unbound20:00:281
2219995652,3cyclictest28187-21kworker/u16:3+events_unbound21:55:241
2219995651,4cyclictest28187-21kworker/u16:3+events_unbound21:35:261
2219995551,3cyclictest28187-21kworker/u16:3+events_unbound20:10:291
2219995551,3cyclictest28187-21kworker/u16:3+events_unbound20:05:021
2219995348,3cyclictest28187-21kworker/u16:3+events_unbound21:30:211
2219995248,3cyclictest28187-21kworker/u16:3+events_unbound20:45:281
2219995147,3cyclictest28187-21kworker/u16:3+events_unbound19:35:131
2219995147,3cyclictest13928-21kworker/u16:2+events_unbound22:25:291
2219995045,3cyclictest3191-21kworker/u16:1+events_unbound00:35:171
2219994945,3cyclictest28187-21kworker/u16:3+events_unbound20:40:201
2219994945,3cyclictest13928-21kworker/u16:2+events_unbound20:50:291
2219994844,3cyclictest28187-21kworker/u16:3+events_unbound23:00:261
2219994844,3cyclictest28187-21kworker/u16:3+events_unbound22:35:231
2219994844,3cyclictest28187-21kworker/u16:3+events_unbound21:50:211
2219994642,3cyclictest28187-21kworker/u16:3+events_unbound20:35:231
2219994642,3cyclictest28187-21kworker/u16:3+events_unbound19:50:171
2219994642,3cyclictest13928-21kworker/u16:2+events_unbound19:30:241
2219994541,3cyclictest13928-21kworker/u16:2+events_unbound22:40:161
2219994541,3cyclictest13928-21kworker/u16:2+events_unbound19:55:301
2219994439,3cyclictest28187-21kworker/u16:3+events_unbound22:35:001
2219994238,3cyclictest28187-21kworker/u16:3+events_unbound21:00:291
2219994238,3cyclictest13928-21kworker/u16:2+events_unbound20:20:271
2219994238,2cyclictest13928-21kworker/u16:2+events_unbound19:40:021
2219994137,3cyclictest13928-21kworker/u16:2+events_unbound23:45:231
2219994137,3cyclictest13928-21kworker/u16:2+events_unbound19:45:341
2219994036,3cyclictest28187-21kworker/u16:3+events_unbound19:15:261
2219993935,3cyclictest28187-21kworker/u16:3+events_unbound23:05:151
2219993935,3cyclictest28187-21kworker/u16:3+events_unbound21:20:291
2219993532,2cyclictest13928-21kworker/u16:2+events_unbound22:55:221
2219993530,4cyclictest3191-21kworker/u16:1+events_unbound23:35:121
2215993429,4cyclictest28187-21kworker/u16:3+events_unbound23:05:270
221599330,17cyclictest0-21swapper/022:00:140
2215993219,10cyclictest23159-21munin-run20:55:000
2219993128,2cyclictest13928-21kworker/u16:2+events_unbound00:15:011
2219993027,2cyclictest3191-21kworker/u16:1+events_unbound00:25:291
2215993024,4cyclictest28187-21kworker/u16:3+events_unbound19:40:330
2215992521,3cyclictest28187-21kworker/u16:3+events_unbound21:00:310
94322230,0sleep20-21swapper/222:10:172
2215992318,4cyclictest32232-40logrotate00:00:000
2215992118,2cyclictest11813-21sadc20:14:590
221599204,11cyclictest12612-21idleruntime-cro21:15:000
2215992016,3cyclictest28187-21kworker/u16:3+events_unbound21:20:310
221599193,11cyclictest16245-21grep22:45:200
221599191,2cyclictest0-21swapper/022:55:140
2223991815,2cyclictest19265-21sendmail22:19:592
222399180,16cyclictest0-21swapper/223:00:142
221599189,8cyclictest7136-21idleruntime-cro21:10:000
2215991814,2cyclictest13928-21kworker/u16:2+events_unbound23:35:270
134062180,1sleep00-21swapper/021:15:150
134062180,1sleep00-21swapper/021:15:150
326272172,13sleep30-21swapper/320:01:333
221599174,10cyclictest0-21swapper/021:45:150
2215991713,3cyclictest3191-21kworker/u16:1+events_unbound00:35:270
222399165,3cyclictest28141-21fschecks_time00:25:182
221599165,6cyclictest0-21swapper/000:03:370
2215991612,3cyclictest681-21gdbus20:00:000
2215991612,3cyclictest26586-21cron19:30:010
221599155,6cyclictest0-21swapper/019:50:420
221599154,6cyclictest0-21swapper/023:20:420
221599154,6cyclictest0-21swapper/022:54:020
221599154,6cyclictest0-21swapper/022:08:430
221599154,6cyclictest0-21swapper/020:47:070
221599154,6cyclictest0-21swapper/019:21:080
221599154,6cyclictest0-21swapper/000:06:280
221599152,8cyclictest18470-21systemctl22:15:250
2215991512,2cyclictest27491-21irqcore23:25:190
222399143,5cyclictest2406-21aten2_r5power_v21:35:162
222399143,4cyclictest9942-21ntp_states00:05:242
222399142,6cyclictest1755-21tr20:35:132
222399140,12cyclictest12852-21apt-get21:15:122
222399140,12cyclictest12852-21apt-get21:15:122
221599149,4cyclictest16066-21cron23:50:000
221599145,8cyclictest0-21swapper/022:29:590
221599145,8cyclictest0-21swapper/021:51:180
221599144,5cyclictest0-21swapper/023:00:180
221599143,8cyclictest28475-21apt-get20:30:130
221599143,6cyclictest0-21swapper/023:53:130
221599143,6cyclictest0-21swapper/023:30:420
221599143,6cyclictest0-21swapper/021:30:230
221599143,6cyclictest0-21swapper/020:17:010
221599143,6cyclictest0-21swapper/019:32:220
221599143,6cyclictest0-21swapper/019:16:470
221599143,6cyclictest0-21swapper/019:14:560
2215991411,2cyclictest1516-21irqcore00:30:190
221599140,8cyclictest11114-21sed20:40:270
221599140,12cyclictest0-21swapper/000:25:290
80292130,0sleep00-21swapper/021:40:170
315842130,1sleep20-21swapper/223:55:262
222399133,5cyclictest13041-21cut22:40:212
222399133,4cyclictest3531-21kthreadcore23:30:222
222399133,4cyclictest30662-21cut20:00:222
222399133,4cyclictest14743-21cut00:10:212
222399132,6cyclictest23858-21kthreadcore00:20:222
222399132,4cyclictest24840-21cut19:25:202
222399131,5cyclictest10558-21mailstats00:35:262
2223991310,2cyclictest0-21swapper/220:34:592
2223991310,2cyclictest0-21swapper/200:15:212
221599139,3cyclictest8343-21unixbench_singl22:35:270
221599139,3cyclictest439-21apt20:05:000
221599135,6cyclictest0-21swapper/021:29:000
221599134,8cyclictest0-21swapper/000:13:340
221599133,5cyclictest0-21swapper/022:30:190
221599132,8cyclictest0-21swapper/023:10:210
221599132,6cyclictest0-21swapper/020:24:370
2215991310,2cyclictest9743-21kthreadcore22:10:180
2215991310,2cyclictest16488-21ls19:50:000
171802130,0sleep30-21swapper/319:20:193
222399129,2cyclictest0-21swapper/222:25:002
222399126,4cyclictest552-21dbus-daemon19:25:002
222399126,4cyclictest10654-21taskset23:40:122
222399125,5cyclictest30479-21apt-get22:30:142
222399124,5cyclictest0-21swapper/220:45:172
222399123,4cyclictest23318-21kthreadcore23:20:212
222399123,4cyclictest16522-21cut21:45:232
222399123,2cyclictest22029-21sensors_temp20:20:282
222399122,6cyclictest4415-21cut21:05:212
222399122,5cyclictest5083-21kthreadcore22:35:202
222399122,5cyclictest19408-21tail21:50:182
222399122,3cyclictest2452-21latency_hist22:05:012
222399121,5cyclictest15053-21cut20:15:232
222399121,4cyclictest20491-21sendmail-msp23:20:002
222399121,2cyclictest0-21swapper/220:10:162
222399120,6cyclictest28020-21kthreadcore19:30:212
222399120,10cyclictest12037-21if_enp0s25.219:45:222
221599129,2cyclictest29405-21awk22:00:010
221599129,2cyclictest0-21swapper/020:35:140
221599128,3cyclictest9021-21apt-get22:40:130
221599123,8cyclictest6052-21tr21:35:240
221599120,2cyclictest19962-21diskstats22:20:160
222399119,1cyclictest7807-21apt-get21:40:132
222399116,4cyclictest3870-21tr00:30:212
222399116,4cyclictest21022-21cut21:20:262
222399115,5cyclictest8437-21irqrtprio21:10:222
222399115,5cyclictest31485-21cut21:30:252
222399115,5cyclictest20442-21kthreadcore20:50:232
222399115,5cyclictest0-21swapper/220:55:172
222399115,5cyclictest0-21swapper/219:50:142
222399114,6cyclictest23399-21kthreadcore19:55:222
222399114,4cyclictest4127-21cut00:00:222
222399114,4cyclictest0-21swapper/222:47:592
222399113,7cyclictest30600-21sendmail23:00:002
222399113,3cyclictest5094-21kthreadcore23:05:212
222399113,2cyclictest9928-21sh19:15:022
222399113,2cyclictest16114-21/usr/sbin/munin23:45:282
222399112,8cyclictest7540-21fschecks_count20:40:232
222399112,4cyclictest30629-21kthreadcore23:25:212
222399112,4cyclictest21402-21kthreadcore22:50:202
222399112,4cyclictest1710-21fschecks_time20:05:202
222399110,8cyclictest10794-21dpkg19:45:012
222399110,4cyclictest0-21swapper/222:05:162
221599118,2cyclictest20489-21sendmail23:20:000
221599114,5cyclictest0-21swapper/020:25:130
221599114,5cyclictest0-21swapper/019:35:160
221599113,5cyclictest0-21swapper/020:59:020
221599111,5cyclictest0-21swapper/000:20:210
222399106,3cyclictest0-21swapper/223:50:152
222399105,4cyclictest5463-21cstates23:35:152
222399105,4cyclictest0-21swapper/220:25:142
222399104,4cyclictest0-21swapper/219:35:122
222399103,5cyclictest27864-21cut22:25:232
222399101,4cyclictest24863-21irqrtprio21:25:222
222399101,2cyclictest0-21swapper/221:00:212
222399100,8cyclictest24501-21cstates21:55:162
22239994,4cyclictest689-21snmpd23:10:032
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
none17:20:357
999270,5sleep30-21swapper/320:05:023
27842270,2sleep30-21swapper/320:25:293
26903270,2sleep30-21swapper/300:20:323
14114270,1sleep30-21swapper/319:15:223
1162270,3sleep30-21swapper/320:33:553
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
none17:20:356
9017260,4sleep30-21swapper/322:40:133
8522260,4sleep30-21swapper/322:10:023
32321260,4sleep30-21swapper/319:35:123
32078260,4sleep30-21swapper/323:30:153
31934260,2sleep30-21swapper/319:33:243
29660260,4sleep30-21swapper/322:00:133
26106260,3sleep30-21swapper/323:22:053
1914260,4sleep30-21swapper/321:05:133
12482260,4sleep30-21swapper/320:45:183
12186260,2sleep30-21swapper/320:44:383
12068260,4sleep30-21swapper/320:15:163
10389260,2sleep30-21swapper/319:42:223
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
none17:20:355
4440250,3sleep30-21swapper/321:35:233
3911250,3sleep30-21swapper/323:05:143
32510250,3sleep30-21swapper/300:00:113
31647250,2sleep30-21swapper/323:27:493
30421250,2sleep30-21swapper/322:57:523
2989250,4sleep30-21swapper/322:31:353
2980250,3sleep30-21swapper/323:00:293
29241250,2sleep30-21swapper/321:58:123
27564250,3sleep30-21swapper/300:25:133
23292250,2sleep30-21swapper/321:21:533
22971250,2sleep30-21swapper/320:52:513
22461251,2sleep30-21swapper/323:50:233
21952250,2sleep30-21swapper/319:54:593
21615250,2sleep30-21swapper/300:18:003
21052250,3sleep30-21swapper/319:25:023
20097250,2sleep30-21swapper/323:15:323
19952250,3sleep30-21swapper/322:20:173
19630251,3sleep30-21swapper/322:49:293
11286250,2sleep30-21swapper/300:40:003
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
none17:20:354
7755240,2sleep30-21swapper/320:10:233
7575240,2sleep30-21swapper/319:14:553
5819240,2sleep30-21swapper/300:34:553
4462240,2sleep30-21swapper/322:35:203
29970240,3sleep30-21swapper/322:26:503
28598240,2sleep30-21swapper/321:00:003
27454240,2sleep30-21swapper/323:55:153
24872241,2sleep30-21swapper/322:51:433
2469240,2sleep30-21swapper/322:05:023
23913240,2sleep30-21swapper/321:54:563
2024240,2sleep30-21swapper/321:34:553
18040240,3sleep30-21swapper/321:19:493
18040240,3sleep30-21swapper/321:19:493
17273240,2sleep30-21swapper/320:20:013
16301240,2sleep30-21swapper/300:14:553
14560240,2sleep30-21swapper/323:14:553
14316240,2sleep30-21swapper/321:45:223
12580240,2sleep30-21swapper/321:14:563
10367240,2sleep30-21swapper/323:40:003
7790230,2sleep30-21swapper/321:40:053
5587230,2sleep30-21swapper/300:05:013
23780230,2sleep30-21swapper/321:25:023
23386230,2sleep30-21swapper/320:55:043
22207230,2sleep30-21swapper/319:55:073
15893230,2sleep30-21swapper/323:45:013
1496230,2sleep30-21swapper/320:35:043
14027230,2sleep30-21swapper/322:15:083
11075230,2sleep30-21swapper/323:40:173
10717230,2sleep30-21swapper/319:45:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional