You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-28 - 09:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot8s.osadl.org (updated Fri Nov 28, 2025 00:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3112428775,9sleep100-21swapper/1019:05:232
275991870,77ptp4l0-21swapper/119:07:281
3203328170,9sleep70-21swapper/719:06:449
3200926755,10sleep110-21swapper/1119:06:243
324302640,0sleep00-21swapper/000:00:210
3196326453,9sleep40-21swapper/419:05:406
3207026352,9sleep50-21swapper/519:07:187
3201726351,9sleep60-21swapper/619:06:318
2896326351,10sleep00-21swapper/019:05:130
131262560,0sleep110-21swapper/1119:25:013
28082550,0sleep50-21swapper/522:00:007
274152530,0sleep60-21swapper/600:35:188
274152530,0sleep60-21swapper/600:35:188
266232510,0sleep20-21swapper/219:40:184
133602220,0sleep110-21swapper/1123:35:173
47122190,0sleep100-21swapper/1000:05:192
47122190,0sleep100-21swapper/1000:05:182
3263499182,10cyclictest0-21swapper/520:40:007
275991180,0ptp4l0-21swapper/123:25:161
275991170,0ptp4l0-21swapper/122:50:201
3264799163,8cyclictest0-21swapper/822:05:2610
3263899164,7cyclictest0-21swapper/620:40:258
3263899163,9cyclictest0-21swapper/622:05:018
3263899163,9cyclictest0-21swapper/621:25:008
3263499163,8cyclictest0-21swapper/521:34:597
3262099163,8cyclictest0-21swapper/220:59:594
275991160,1ptp4l21-21ksoftirqd/119:50:221
275991160,0ptp4l0-21swapper/122:35:161
275991160,0ptp4l0-21swapper/121:25:201
275991160,0ptp4l0-21swapper/100:15:251
275991160,0ptp4l0-21swapper/100:15:241
182592160,0sleep10-21swapper/120:55:131
3264799153,8cyclictest0-21swapper/823:30:0010
3264799153,7cyclictest0-21swapper/819:10:0110
3263899153,9cyclictest0-21swapper/623:50:008
3263899153,8cyclictest0-21swapper/621:20:008
3263899152,9cyclictest0-21swapper/623:25:018
3263899152,8cyclictest0-21swapper/621:15:008
3263899152,8cyclictest0-21swapper/620:25:018
3263499153,7cyclictest0-21swapper/522:59:597
3263499151,8cyclictest0-21swapper/519:30:007
3262599151,13cyclictest0-21swapper/323:00:185
3262099152,8cyclictest0-21swapper/222:50:014
275991150,1ptp4l21-21ksoftirqd/121:15:171
275991150,0ptp4l0-21swapper/122:20:141
275991150,0ptp4l0-21swapper/120:30:181
3264799143,7cyclictest0-21swapper/820:25:0010
3263899144,7cyclictest0-21swapper/620:40:008
3263899142,9cyclictest0-21swapper/621:05:008
3263499143,7cyclictest0-21swapper/519:55:017
275991140,1ptp4l21-21ksoftirqd/119:25:241
275991140,1ptp4l0-21swapper/123:25:011
275991140,0ptp4l0-21swapper/119:40:221
275991140,0ptp4l0-21swapper/100:20:161
275991140,0ptp4l0-21swapper/100:20:151
101992140,0sleep20-21swapper/220:00:204
62292130,0sleep30-21swapper/300:10:015
62292130,0sleep30-21swapper/300:10:015
35882130,0sleep100-21swapper/1019:10:342
3264799133,6cyclictest0-21swapper/800:30:0110
3264799133,6cyclictest0-21swapper/800:30:0010
3264799132,6cyclictest0-21swapper/820:00:0010
3264799130,1cyclictest0-21swapper/819:55:0110
3263899132,8cyclictest26365-21kworker/u24:319:20:018
3263899131,7cyclictest0-21swapper/619:55:018
3263499132,7cyclictest0-21swapper/519:50:007
3263499132,6cyclictest0-21swapper/520:22:287
3261699133,6cyclictest0-21swapper/120:05:011
3261699133,5cyclictest0-21swapper/120:55:001
275991130,1ptp4l21-21ksoftirqd/119:55:191
275991130,0ptp4l0-21swapper/122:25:151
275991130,0ptp4l0-21swapper/121:40:131
275991130,0ptp4l0-21swapper/120:40:121
275991130,0ptp4l0-21swapper/120:20:181
275991130,0ptp4l0-21swapper/100:05:171
275991130,0ptp4l0-21swapper/100:05:171
3263899121,7cyclictest0-21swapper/622:20:248
3262099122,7cyclictest0-21swapper/223:20:004
3262099120,2cyclictest5193-21perl23:25:164
3261699123,6cyclictest0-21swapper/120:50:001
275991120,4ptp4l21-21ksoftirqd/122:10:251
275991120,3ptp4l3111-21date22:00:011
275991120,1ptp4l21-21ksoftirqd/122:00:141
275991120,1ptp4l21-21ksoftirqd/121:20:201
275991120,0ptp4l0-21swapper/123:56:111
275991120,0ptp4l0-21swapper/123:38:331
275991120,0ptp4l0-21swapper/123:05:191
275991120,0ptp4l0-21swapper/122:45:501
275991120,0ptp4l0-21swapper/122:09:591
275991120,0ptp4l0-21swapper/121:35:311
275991120,0ptp4l0-21swapper/121:05:181
275991120,0ptp4l0-21swapper/100:36:391
275991120,0ptp4l0-21swapper/100:36:381
191591120,0getstats0-21swapper/219:35:124
3266299111,7cyclictest28904-21diskmemload21:35:003
3266299110,10cyclictest512-1kworker/11:1H22:30:003
3265299112,6cyclictest0-21swapper/920:59:5911
3263899112,8cyclictest0-21swapper/621:40:258
3263899110,1cyclictest0-21swapper/623:19:048
3263899110,1cyclictest0-21swapper/600:19:168
3263899110,1cyclictest0-21swapper/600:19:168
3263899110,11cyclictest0-21swapper/623:00:018
3263499111,6cyclictest0-21swapper/521:45:007
3262599113,7cyclictest0-21swapper/319:45:015
3262599110,10cyclictest0-21swapper/320:40:005
3262099112,6cyclictest0-21swapper/222:55:014
3262099112,6cyclictest0-21swapper/221:55:004
3262099112,6cyclictest0-21swapper/221:10:004
3262099111,2cyclictest10582-21perl19:20:184
3262099110,10cyclictest0-21swapper/223:04:594
3262099110,10cyclictest0-21swapper/221:55:244
3261699112,6cyclictest0-21swapper/120:30:011
32611991110,1cyclictest0-21swapper/023:15:260
32611991110,1cyclictest0-21swapper/000:30:420
32611991110,1cyclictest0-21swapper/000:30:410
3261199110,1cyclictest0-21swapper/023:39:540
286452110,0sleep90-21swapper/919:45:0111
275991110,3ptp4l21-21ksoftirqd/123:50:221
275991110,3ptp4l0-21swapper/123:00:271
275991110,2ptp4l18336-21perl19:30:141
275991110,2ptp4l14156-21df22:55:161
275991110,1ptp4l21-21ksoftirqd/120:35:061
275991110,1ptp4l0-21swapper/121:45:141
275991110,0ptp4l0-21swapper/122:30:181
275991110,0ptp4l0-21swapper/121:10:131
275991110,0ptp4l0-21swapper/119:20:251
275991110,0ptp4l0-21swapper/119:10:161
275991110,0ptp4l0-21swapper/100:30:231
275991110,0ptp4l0-21swapper/100:30:231
275991110,0ptp4l0-21swapper/100:25:141
275991110,0ptp4l0-21swapper/100:25:131
3266299101,6cyclictest0-21swapper/1123:50:013
3265299102,5cyclictest0-21swapper/923:40:0111
3265299102,5cyclictest0-21swapper/922:29:5911
3265299101,6cyclictest0-21swapper/919:40:0011
3265299101,5cyclictest0-21swapper/919:55:0111
3264399100,9cyclictest0-21swapper/722:15:139
3264399100,1cyclictest0-21swapper/720:00:139
3263899109,1cyclictest0-21swapper/623:56:028
3263899109,1cyclictest0-21swapper/623:32:038
3263899109,1cyclictest0-21swapper/623:25:458
3263899109,1cyclictest0-21swapper/600:24:278
3263899109,1cyclictest0-21swapper/600:24:268
3263899109,1cyclictest0-21swapper/600:10:358
3263899108,1cyclictest0-21swapper/623:40:258
3263899104,5cyclictest0-21swapper/623:45:268
3263899100,1cyclictest0-21swapper/622:55:158
3263899100,1cyclictest0-21swapper/600:33:128
3263899100,1cyclictest0-21swapper/600:33:128
3263899100,1cyclictest0-21swapper/600:25:038
3263899100,1cyclictest0-21swapper/600:25:038
3263899100,1cyclictest0-21swapper/600:00:078
3263899100,10cyclictest0-21swapper/623:35:058
3263899100,10cyclictest0-21swapper/623:13:068
3263899100,10cyclictest0-21swapper/623:06:408
3263899100,10cyclictest0-21swapper/600:05:478
3263899100,10cyclictest0-21swapper/600:05:468
3263499103,6cyclictest0-21swapper/519:15:017
3263499100,9cyclictest0-21swapper/521:50:167
3262599104,5cyclictest0-21swapper/320:30:245
3262599103,6cyclictest0-21swapper/320:00:015
3262599102,6cyclictest0-21swapper/322:25:015
3262599100,9cyclictest0-21swapper/321:10:135
3262099102,5cyclictest0-21swapper/221:25:004
3261199109,1cyclictest0-21swapper/023:40:240
3261199109,1cyclictest0-21swapper/023:25:590
3261199109,1cyclictest0-21swapper/023:10:030
3261199109,1cyclictest0-21swapper/022:58:330
3261199109,1cyclictest0-21swapper/000:17:550
3261199109,1cyclictest0-21swapper/000:17:550
3261199109,1cyclictest0-21swapper/000:10:060
3261199102,5cyclictest0-21swapper/020:20:010
3261199102,4cyclictest0-21swapper/019:30:010
3261199101,6cyclictest0-21swapper/020:25:000
3261199100,1cyclictest0-21swapper/023:52:350
3261199100,1cyclictest0-21swapper/000:07:130
3261199100,1cyclictest0-21swapper/000:07:120
3261199100,10cyclictest0-21swapper/023:56:000
3261199100,10cyclictest0-21swapper/023:45:120
3261199100,10cyclictest0-21swapper/023:32:030
3261199100,10cyclictest0-21swapper/023:20:380
3261199100,10cyclictest0-21swapper/023:06:250
3261199100,10cyclictest0-21swapper/023:02:320
3261199100,10cyclictest0-21swapper/000:37:550
3261199100,10cyclictest0-21swapper/000:37:540
3261199100,10cyclictest0-21swapper/000:26:000
3261199100,10cyclictest0-21swapper/000:26:000
3261199100,10cyclictest0-21swapper/000:24:250
3261199100,10cyclictest0-21swapper/000:24:240
275991100,2ptp4l2360-21cstates22:40:141
275991100,2ptp4l20091-21cstates23:45:141
275991100,1ptp4l5691-21if_p34p119:15:021
275991100,1ptp4l29462-21diskstats19:45:121
275991100,1ptp4l29137-21hddtemp_smartct21:50:191
275991100,1ptp4l20277-21df20:15:131
275991100,1ptp4l17094-21ps22:15:211
275991100,1ptp4l16935-21cat23:40:181
275991100,1ptp4l16470-21diskstats20:10:141
275991100,1ptp4l10267-21/usr/sbin/munin20:00:191
275991100,0ptp4l0-21swapper/123:15:061
9498090,5rtkit-daemon0-21swapper/919:05:2111
326629992,4cyclictest0-21swapper/1120:05:013
326629990,9cyclictest0-21swapper/1123:55:243
326629990,9cyclictest0-21swapper/1119:45:133
326629990,1cyclictest0-21swapper/1120:25:203
326569997,1cyclictest0-21swapper/1020:35:012
326529998,1cyclictest0-21swapper/920:15:1411
326529992,5cyclictest0-21swapper/923:35:0011
326529991,5cyclictest0-21swapper/923:49:5911
326529991,5cyclictest0-21swapper/900:25:0111
326529991,5cyclictest0-21swapper/900:25:0011
326529990,8cyclictest8563-21unixbench-2d22:45:2511
326529990,8cyclictest0-21swapper/919:55:1611
326479997,1cyclictest0-21swapper/819:35:0110
326479992,6cyclictest0-21swapper/821:30:2610
326479990,1cyclictest0-21swapper/821:05:1610
326439998,1cyclictest0-21swapper/723:35:169
326439998,1cyclictest0-21swapper/721:45:179
326439998,1cyclictest0-21swapper/721:30:149
326439998,1cyclictest0-21swapper/721:25:219
326439998,1cyclictest0-21swapper/720:20:149
326439997,1cyclictest0-21swapper/722:35:159
326439995,3cyclictest6157-21missed_timers19:55:199
326439990,9cyclictest0-21swapper/722:30:139
326439990,9cyclictest0-21swapper/720:45:149
326439990,8cyclictest0-21swapper/720:41:349
326439990,1cyclictest0-21swapper/723:20:269
326439990,1cyclictest0-21swapper/722:00:159
326389997,1cyclictest0-21swapper/622:10:128
326389990,1cyclictest0-21swapper/622:40:178
326389990,1cyclictest0-21swapper/621:25:228
326389990,1cyclictest0-21swapper/620:05:158
326349993,3cyclictest0-21swapper/521:25:007
326299992,6cyclictest19721-21crond21:40:006
326259998,1cyclictest0-21swapper/319:25:015
326259992,6cyclictest0-21swapper/322:45:015
326259992,4cyclictest0-21swapper/323:25:155
326259990,8cyclictest0-21swapper/323:20:165
326259990,8cyclictest0-21swapper/322:00:155
326259990,1cyclictest0-21swapper/300:10:195
326209998,1cyclictest0-21swapper/223:05:164
326209990,9cyclictest0-21swapper/221:00:234
326209990,8cyclictest17527-21perl21:35:164
326209990,1cyclictest0-21swapper/219:50:264
326119990,2cyclictest7631-21memory19:15:180
27609190,3phc2sys0-21swapper/219:07:384
27599190,0ptp4l0-21swapper/123:30:131
27599190,0ptp4l0-21swapper/123:10:141
27599190,0ptp4l0-21swapper/121:30:141
27599190,0ptp4l0-21swapper/121:00:181
27599190,0ptp4l0-21swapper/119:35:131
27599190,0ptp4l0-21swapper/100:10:131
27599190,0ptp4l0-21swapper/100:00:161
326629987,1cyclictest1020-21runrttasks22:15:233
326629987,1cyclictest0-21swapper/1123:05:203
326629987,1cyclictest0-21swapper/1121:00:223
326629981,5cyclictest0-21swapper/1123:25:253
326629981,5cyclictest0-21swapper/1122:35:013
326629981,5cyclictest0-21swapper/1121:50:003
326629980,8cyclictest0-21swapper/1123:40:163
326629980,8cyclictest0-21swapper/1100:30:203
326629980,8cyclictest0-21swapper/1100:30:203
326629980,1cyclictest0-21swapper/1121:17:433
326629980,1cyclictest0-21swapper/1120:45:133
326629980,0cyclictest0-21swapper/1121:35:233
326569985,2cyclictest0-21swapper/1019:15:012
326569980,8cyclictest0-21swapper/1019:35:162
326569980,8cyclictest0-21swapper/1000:00:162
326569980,1cyclictest0-21swapper/1023:25:232
326569980,1cyclictest0-21swapper/1022:21:352
326569980,1cyclictest0-21swapper/1021:15:252
326569980,1cyclictest0-21swapper/1020:10:192
326569980,1cyclictest0-21swapper/1019:55:012
326529987,1cyclictest0-21swapper/921:57:5211
326529987,1cyclictest0-21swapper/920:40:1411
326529987,1cyclictest0-21swapper/920:30:2011
326529987,1cyclictest0-21swapper/900:30:2611
326529987,1cyclictest0-21swapper/900:30:2611
326529982,4cyclictest0-21swapper/921:55:0011
326529982,4cyclictest0-21swapper/921:44:5911
326529981,5cyclictest0-21swapper/921:45:2511
326529981,4cyclictest0-21swapper/922:10:0111
326529980,8cyclictest0-21swapper/920:20:2211
326529980,8cyclictest0-21swapper/900:05:2111
326529980,8cyclictest0-21swapper/900:05:2011
326529980,1cyclictest0-21swapper/922:35:2011
326529980,1cyclictest0-21swapper/921:30:2211
326529980,1cyclictest0-21swapper/920:50:2911
326529980,1cyclictest0-21swapper/920:25:1711
326479982,4cyclictest0-21swapper/819:25:1510
326479980,8cyclictest0-21swapper/820:05:2310
326479980,1cyclictest0-21swapper/820:55:1310
326479980,1cyclictest0-21swapper/800:10:2510
326439987,1cyclictest0-21swapper/723:15:189
326439987,1cyclictest0-21swapper/722:20:149
326439987,1cyclictest0-21swapper/721:20:159
326439987,1cyclictest0-21swapper/721:20:009
326439987,1cyclictest0-21swapper/719:45:179
326439984,3cyclictest0-21swapper/723:45:019
326439983,4cyclictest0-21swapper/723:10:009
326439980,8cyclictest0-21swapper/723:00:279
326439980,8cyclictest0-21swapper/721:35:219
326439980,8cyclictest0-21swapper/700:00:159
326439980,1cyclictest0-21swapper/721:10:229
326439980,1cyclictest0-21swapper/720:30:219
326439980,1cyclictest0-21swapper/719:28:359
326389987,1cyclictest0-21swapper/620:15:208
326389987,1cyclictest0-21swapper/619:35:178
326389987,1cyclictest0-21swapper/619:25:008
326389985,2cyclictest31205-21turbostat21:54:598
326389982,4cyclictest0-21swapper/621:35:168
326389980,8cyclictest0-21swapper/622:15:148
326389980,7cyclictest0-21swapper/620:00:208
326349985,2cyclictest21247-21turbostat21:00:007
326349982,5cyclictest0-21swapper/500:00:007
326349980,8cyclictest0-21swapper/523:45:147
326349980,8cyclictest0-21swapper/523:20:257
326349980,1cyclictest0-21swapper/522:15:157
326349980,1cyclictest0-21swapper/520:25:177
326299987,1cyclictest0-21swapper/422:35:176
326299987,1cyclictest0-21swapper/421:50:206
326299987,1cyclictest0-21swapper/400:15:156
326299987,1cyclictest0-21swapper/400:15:146
326299980,8cyclictest0-21swapper/422:50:146
326299980,8cyclictest0-21swapper/422:40:256
326259987,1cyclictest0-21swapper/323:55:125
326259987,1cyclictest0-21swapper/323:10:245
326259987,1cyclictest0-21swapper/321:55:245
326259987,1cyclictest0-21swapper/321:00:205
326259987,1cyclictest0-21swapper/320:50:175
326259980,8cyclictest0-21swapper/322:45:145
326259980,8cyclictest0-21swapper/321:15:155
326259980,1cyclictest0-21swapper/322:55:265
326259980,1cyclictest0-21swapper/321:35:265
326209987,1cyclictest0-21swapper/222:25:194
326209987,1cyclictest0-21swapper/220:54:594
326209980,8cyclictest0-21swapper/220:40:214
326209980,8cyclictest0-21swapper/220:25:134
326209980,8cyclictest0-21swapper/220:10:234
326209980,8cyclictest0-21swapper/219:45:164
326209980,8cyclictest0-21swapper/200:10:194
326209980,7cyclictest28904-21diskmemload23:36:414
326209980,7cyclictest26617-21fschecks_time00:35:144
326209980,7cyclictest26617-21fschecks_time00:35:134
326209980,3cyclictest31264-21cpuspeed_turbos00:00:154
326209980,3cyclictest25796-21/usr/sbin/munin21:45:184
326209980,2cyclictest12232-21memory00:15:214
326209980,2cyclictest12232-21memory00:15:204
326209980,1cyclictest0-21swapper/222:00:274
326209980,1cyclictest0-21swapper/221:30:014
326209980,1cyclictest0-21swapper/220:30:244
326119981,4cyclictest0-21swapper/021:40:000
326119980,7cyclictest28904-21diskmemload21:27:470
326119980,5cyclictest0-21swapper/021:05:010
31933281,5sleep30-21swapper/319:05:275
326629976,1cyclictest0-21swapper/1123:30:503
326629976,1cyclictest0-21swapper/1123:15:253
326629976,1cyclictest0-21swapper/1123:10:263
326629976,1cyclictest0-21swapper/1123:00:213
326629976,1cyclictest0-21swapper/1122:10:013
326629976,1cyclictest0-21swapper/1122:00:353
326629976,1cyclictest0-21swapper/1121:41:493
326629976,1cyclictest0-21swapper/1120:55:143
326629976,1cyclictest0-21swapper/1120:30:153
326629976,1cyclictest0-21swapper/1120:21:013
326629976,1cyclictest0-21swapper/1120:13:253
326629976,1cyclictest0-21swapper/1119:10:123
326629974,2cyclictest14336-21timerandwakeup20:05:253
326629970,7cyclictest0-21swapper/1123:52:443
326629970,7cyclictest0-21swapper/1123:20:313
326629970,7cyclictest0-21swapper/1121:20:353
326629970,7cyclictest0-21swapper/1121:10:073
326629970,7cyclictest0-21swapper/1119:55:263
326629970,7cyclictest0-21swapper/1119:15:353
326629970,7cyclictest0-21swapper/1100:25:383
326629970,7cyclictest0-21swapper/1100:25:383
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional