You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-07 - 02:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot8s.osadl.org (updated Sun Dec 07, 2025 00:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2759911060,95ptp4l0-21swapper/119:07:431
1558426654,10sleep50-21swapper/519:08:187
1542826554,9sleep40-21swapper/419:06:166
1465226555,5sleep110-21swapper/1119:05:233
1566926452,10sleep100-21swapper/1019:09:352
1542426351,10sleep00-21swapper/019:06:120
247282620,0sleep110-21swapper/1121:25:143
251922610,0sleep10-21swapper/123:30:181
251922610,0sleep10-21swapper/123:30:181
1567926049,8sleep70-21swapper/719:09:449
76262590,0sleep70-21swapper/700:30:309
279682590,0sleep90-21swapper/921:30:0011
1557225948,9sleep60-21swapper/619:08:078
81502560,0sleep10-21swapper/122:25:221
1611899190,17cyclictest0-21swapper/1119:40:193
1609799183,9cyclictest0-21swapper/720:45:009
1608499182,12cyclictest0-21swapper/420:00:006
1607999172,9cyclictest0-21swapper/322:00:005
1606999173,9cyclictest0-21swapper/122:50:011
1606999172,9cyclictest0-21swapper/119:20:001
275991160,1ptp4l21-21ksoftirqd/123:55:161
275991160,1ptp4l21-21ksoftirqd/122:15:261
275991160,1ptp4l21-21ksoftirqd/119:20:251
275991160,0ptp4l0-21swapper/121:45:241
275991160,0ptp4l0-21swapper/120:40:011
265322160,0sleep50-21swapper/522:50:177
1609799163,9cyclictest12810-21kworker/u24:200:20:019
1609799163,8cyclictest0-21swapper/720:15:009
1608899164,7cyclictest0-21swapper/520:14:597
1607999163,8cyclictest0-21swapper/323:50:015
16069991612,2cyclictest0-21swapper/121:00:181
275991150,0ptp4l0-21swapper/123:40:201
275991150,0ptp4l0-21swapper/121:10:181
1611899151,2cyclictest0-21swapper/1121:40:183
1611899150,1cyclictest0-21swapper/1119:30:013
1609399154,6cyclictest0-21swapper/621:30:008
1608899153,7cyclictest0-21swapper/521:55:007
1607999154,8cyclictest12810-21kworker/u24:220:05:005
1607999153,7cyclictest0-21swapper/320:55:255
1607999153,7cyclictest0-21swapper/300:08:165
1606999153,7cyclictest0-21swapper/121:00:001
1606999153,6cyclictest0-21swapper/120:10:001
1606999152,8cyclictest0-21swapper/120:20:001
275991140,1ptp4l21-21ksoftirqd/121:50:161
275991140,1ptp4l21-21ksoftirqd/100:15:181
185872140,0sleep50-21swapper/522:40:157
1611899141,2cyclictest5856-21if_err_p34p119:35:173
1611299140,1cyclictest0-21swapper/1021:30:182
1610699140,13cyclictest4672-21awk21:00:0011
1609799143,6cyclictest0-21swapper/719:30:019
1609799142,8cyclictest0-21swapper/723:10:009
1609799142,7cyclictest0-21swapper/723:25:019
1609799142,7cyclictest0-21swapper/723:25:019
1608899143,7cyclictest0-21swapper/519:55:007
1608899142,8cyclictest0-21swapper/500:40:017
16084991412,2cyclictest569-21turbostat00:29:556
1607999143,7cyclictest0-21swapper/321:20:005
1606999143,7cyclictest0-21swapper/121:30:001
1611899132,7cyclictest0-21swapper/1100:00:013
1611899132,6cyclictest0-21swapper/1100:35:013
1611899130,7cyclictest0-21swapper/1119:20:013
1611899130,2cyclictest0-21swapper/1122:35:183
1611899130,1cyclictest0-21swapper/1121:20:003
1610699132,6cyclictest0-21swapper/923:30:0111
1610699132,6cyclictest0-21swapper/923:30:0111
1610699132,6cyclictest0-21swapper/900:00:0111
1610699130,12cyclictest0-21swapper/900:10:0011
1609799133,6cyclictest0-21swapper/723:15:009
1609799133,6cyclictest0-21swapper/723:15:009
1609799132,7cyclictest0-21swapper/721:05:009
1609799131,7cyclictest12810-21kworker/u24:219:45:009
1609399133,6cyclictest0-21swapper/621:00:008
1608899133,7cyclictest0-21swapper/523:50:007
1608899132,7cyclictest0-21swapper/521:35:007
1608499130,1cyclictest0-21swapper/421:40:186
1607999132,7cyclictest0-21swapper/322:10:285
1607999132,6cyclictest0-21swapper/319:10:015
1607999131,8cyclictest0-21swapper/319:20:015
275991120,1ptp4l21-21ksoftirqd/122:44:021
275991120,0ptp4l0-21swapper/122:46:261
275991120,0ptp4l0-21swapper/119:47:301
275991120,0ptp4l0-21swapper/100:36:381
1611899121,7cyclictest0-21swapper/1122:15:003
16112991210,1cyclictest0-21swapper/1022:20:002
1610699122,6cyclictest0-21swapper/900:20:0011
1609799121,7cyclictest0-21swapper/722:30:249
1609399122,6cyclictest0-21swapper/622:10:008
1608899122,6cyclictest0-21swapper/522:55:247
1608899122,6cyclictest0-21swapper/522:40:007
1608899122,6cyclictest0-21swapper/521:25:257
1607999122,6cyclictest0-21swapper/322:20:255
141312121,8sleep80-21swapper/819:05:2010
275991110,2ptp4l4378-21irqrtprio23:45:181
275991110,2ptp4l21-21ksoftirqd/123:00:141
275991110,1ptp4l21-21ksoftirqd/119:58:561
275991110,1ptp4l0-21swapper/123:15:221
275991110,1ptp4l0-21swapper/123:15:221
275991110,1ptp4l0-21swapper/121:20:151
275991110,1ptp4l0-21swapper/121:05:191
275991110,0ptp4l0-21swapper/122:09:581
275991110,0ptp4l0-21swapper/119:28:281
1611299110,8cyclictest0-21swapper/1000:15:142
1610699118,2cyclictest24134-21date21:25:0011
1610699112,6cyclictest12810-21kworker/u24:223:40:0011
1610699112,5cyclictest0-21swapper/922:00:0011
1610699111,6cyclictest0-21swapper/923:30:2411
1610699111,6cyclictest0-21swapper/923:30:2411
1610699110,6cyclictest0-21swapper/919:20:0011
1609399112,5cyclictest12810-21kworker/u24:221:35:008
1608899110,10cyclictest29163-21munin-run20:50:007
1608899110,10cyclictest0-21swapper/523:40:117
1607999112,6cyclictest0-21swapper/323:15:285
1607999112,6cyclictest0-21swapper/323:15:285
275991100,1ptp4l32047-21cat20:50:251
275991100,1ptp4l30862-21fw_forwarded_lo00:20:161
275991100,1ptp4l29386-21latency_hist20:50:001
275991100,1ptp4l15591-21/usr/sbin/munin00:00:161
275991100,1ptp4l0-21swapper/119:35:001
275991100,1ptp4l0-21swapper/100:05:141
275991100,0ptp4l0-21swapper/122:10:211
275991100,0ptp4l0-21swapper/121:55:221
275991100,0ptp4l0-21swapper/121:40:211
275991100,0ptp4l0-21swapper/121:15:141
1611899107,2cyclictest7529-21df_inode20:20:143
1611899100,1cyclictest0-21swapper/1121:20:153
1611299103,3cyclictest17818-21grep22:40:142
1611299100,9cyclictest0-21swapper/1019:15:012
1611299100,1cyclictest0-21swapper/1019:34:562
1610699101,6cyclictest12810-21kworker/u24:223:10:0011
1609799108,1cyclictest0-21swapper/722:45:189
1609799102,7cyclictest0-21swapper/720:00:009
1609799101,5cyclictest0-21swapper/723:15:019
1609799101,5cyclictest0-21swapper/723:15:019
1609399103,4cyclictest0-21swapper/623:05:018
1609399102,5cyclictest0-21swapper/621:55:008
1609399102,5cyclictest0-21swapper/600:30:018
1609399101,6cyclictest0-21swapper/623:50:018
1609399100,1cyclictest0-21swapper/623:55:238
1608899104,4cyclictest0-21swapper/519:40:007
1608899102,5cyclictest0-21swapper/523:35:017
1608899100,9cyclictest0-21swapper/500:00:257
1608899100,2cyclictest0-21swapper/520:35:147
1608499108,2cyclictest0-21swapper/421:50:236
1608499100,9cyclictest23964-21memory20:40:226
1607599100,9cyclictest0-21swapper/222:40:194
1606699103,6cyclictest0-21swapper/022:30:000
1606699103,6cyclictest0-21swapper/021:45:000
1606699103,6cyclictest0-21swapper/019:55:000
1606699103,6cyclictest0-21swapper/019:15:010
1606699103,6cyclictest0-21swapper/000:10:010
1606699102,7cyclictest0-21swapper/023:35:280
1606699102,7cyclictest0-21swapper/023:35:000
1606699102,7cyclictest0-21swapper/023:35:000
1606699102,7cyclictest0-21swapper/023:05:000
1606699101,8cyclictest0-21swapper/021:45:000
1606699100,1cyclictest0-21swapper/021:20:230
27599190,1ptp4l21-21ksoftirqd/122:00:011
27599190,1ptp4l21-21ksoftirqd/119:40:151
27599190,1ptp4l21-21ksoftirqd/119:10:131
27599190,0ptp4l0-21swapper/123:50:141
27599190,0ptp4l0-21swapper/123:35:161
27599190,0ptp4l0-21swapper/123:25:111
27599190,0ptp4l0-21swapper/123:25:111
27599190,0ptp4l0-21swapper/123:20:151
27599190,0ptp4l0-21swapper/123:20:141
27599190,0ptp4l0-21swapper/123:10:151
27599190,0ptp4l0-21swapper/123:10:151
27599190,0ptp4l0-21swapper/123:05:141
27599190,0ptp4l0-21swapper/122:55:151
27599190,0ptp4l0-21swapper/122:35:111
27599190,0ptp4l0-21swapper/122:30:121
27599190,0ptp4l0-21swapper/122:20:141
27599190,0ptp4l0-21swapper/121:35:131
27599190,0ptp4l0-21swapper/121:25:141
27599190,0ptp4l0-21swapper/120:35:131
27599190,0ptp4l0-21swapper/120:30:151
27599190,0ptp4l0-21swapper/120:25:151
27599190,0ptp4l0-21swapper/120:20:011
27599190,0ptp4l0-21swapper/120:10:191
27599190,0ptp4l0-21swapper/120:00:151
27599190,0ptp4l0-21swapper/119:50:161
27599190,0ptp4l0-21swapper/119:35:131
27599190,0ptp4l0-21swapper/100:25:151
27599190,0ptp4l0-21swapper/100:10:201
161189998,1cyclictest0-21swapper/1123:50:003
161189990,1cyclictest0-21swapper/1123:00:243
161129998,1cyclictest0-21swapper/1022:00:152
161129997,1cyclictest0-21swapper/1021:45:002
161129993,2cyclictest0-21swapper/1019:59:552
161129990,2cyclictest1009-21snmpd20:59:172
161069996,2cyclictest18416-21fschecks_count22:40:1611
161069990,8cyclictest29493-21expr22:55:1311
161069990,8cyclictest0-21swapper/919:30:2211
161029998,1cyclictest0-21swapper/819:55:2610
161029998,1cyclictest0-21swapper/819:20:2310
161029998,1cyclictest0-21swapper/800:25:2110
161029990,9cyclictest0-21swapper/820:35:1810
161029990,9cyclictest0-21swapper/820:00:1410
161029990,9cyclictest0-21swapper/819:25:1710
160979991,6cyclictest0-21swapper/722:15:009
160939998,1cyclictest0-21swapper/600:10:318
160939998,1cyclictest0-21swapper/600:05:268
160939992,4cyclictest0-21swapper/620:25:248
160939991,5cyclictest0-21swapper/622:50:018
160939991,5cyclictest0-21swapper/620:05:008
160939990,9cyclictest0-21swapper/623:55:008
160939990,9cyclictest0-21swapper/622:55:158
160939990,9cyclictest0-21swapper/620:50:148
160939990,1cyclictest0-21swapper/620:45:158
160939990,1cyclictest0-21swapper/600:35:198
160889998,1cyclictest0-21swapper/519:50:147
160889998,1cyclictest0-21swapper/500:25:167
160889992,4cyclictest0-21swapper/523:20:007
160889992,4cyclictest0-21swapper/523:20:007
160889990,9cyclictest0-21swapper/521:15:147
160889990,8cyclictest0-21swapper/519:30:017
160889990,1cyclictest0-21swapper/522:00:147
160849998,1cyclictest381rcuc/421:22:476
160849992,4cyclictest0-21swapper/421:20:006
160849990,9cyclictest0-21swapper/419:45:206
160849990,1cyclictest0-21swapper/420:39:596
160759998,1cyclictest0-21swapper/223:00:134
160759998,1cyclictest0-21swapper/220:45:144
160759998,1cyclictest0-21swapper/220:25:134
160759990,8cyclictest0-21swapper/223:20:144
160759990,8cyclictest0-21swapper/223:20:144
160759990,8cyclictest0-21swapper/220:35:144
160759990,8cyclictest0-21swapper/220:05:154
160759990,8cyclictest0-21swapper/219:15:174
160759990,1cyclictest0-21swapper/222:10:284
160759990,1cyclictest0-21swapper/221:05:194
160759990,1cyclictest0-21swapper/219:55:174
160759990,1cyclictest0-21swapper/200:10:214
160699991,8cyclictest201rcuc/100:30:191
160669993,5cyclictest0-21swapper/023:45:000
160669992,6cyclictest0-21swapper/022:20:000
160669992,6cyclictest0-21swapper/020:55:000
160669992,6cyclictest0-21swapper/020:00:000
160669992,6cyclictest0-21swapper/019:45:000
160669992,6cyclictest0-21swapper/000:10:010
15350291,6sleep30-21swapper/319:05:265
27609180,1phc2sys0-21swapper/222:05:134
24784280,0chrt0-21swapper/019:20:010
161189985,2cyclictest12059-21sed23:15:013
161189980,7cyclictest12341-21diskmemload23:06:213
161189980,1cyclictest0-21swapper/1121:35:213
161189980,1cyclictest0-21swapper/1120:00:213
161189980,1cyclictest0-21swapper/1100:00:223
161129987,1cyclictest0-21swapper/1021:05:132
161129987,1cyclictest0-21swapper/1020:00:242
161129982,4cyclictest0-21swapper/1021:00:162
161129980,1cyclictest0-21swapper/1022:20:252
161069987,1cyclictest0-21swapper/922:05:2611
161069980,8cyclictest0-21swapper/923:00:1611
161069980,7cyclictest0-21swapper/922:04:5511
161069980,3cyclictest0-21swapper/900:24:5511
161029987,1cyclictest0-21swapper/822:45:2410
161029987,1cyclictest0-21swapper/820:20:2510
161029980,8cyclictest0-21swapper/821:35:1710
161029980,8cyclictest0-21swapper/821:10:1910
161029980,8cyclictest0-21swapper/820:10:1710
161029980,8cyclictest0-21swapper/800:20:2310
161029980,1cyclictest0-21swapper/823:20:0110
161029980,1cyclictest0-21swapper/823:20:0110
161029980,1cyclictest0-21swapper/822:55:1210
161029980,1cyclictest0-21swapper/821:08:0110
161029980,1cyclictest0-21swapper/820:45:1510
161029980,1cyclictest0-21swapper/800:05:2110
160979987,1cyclictest0-21swapper/720:50:259
160979980,1cyclictest0-21swapper/719:15:179
160939987,1cyclictest0-21swapper/621:35:128
160939987,1cyclictest0-21swapper/620:42:358
160939987,1cyclictest0-21swapper/620:20:158
160939984,3cyclictest21911-21cat21:20:178
160939981,5cyclictest0-21swapper/619:30:018
160939981,4cyclictest0-21swapper/620:34:598
160939981,4cyclictest0-21swapper/620:15:258
160939980,8cyclictest0-21swapper/621:55:138
160939980,8cyclictest0-21swapper/621:00:258
160939980,8cyclictest0-21swapper/619:50:248
160939980,7cyclictest0-21swapper/619:10:198
160939980,1cyclictest0-21swapper/623:32:598
160939980,1cyclictest0-21swapper/623:32:598
160939980,1cyclictest0-21swapper/622:30:018
160939980,1cyclictest0-21swapper/619:55:208
160889987,1cyclictest0-21swapper/523:00:187
160889987,1cyclictest0-21swapper/522:15:247
160889987,1cyclictest0-21swapper/522:05:187
160889987,1cyclictest0-21swapper/521:40:177
160889987,1cyclictest0-21swapper/519:30:177
160889986,1cyclictest12341-21diskmemload21:11:427
160889985,2cyclictest23050-21turbostat20:04:557
160889980,8cyclictest0-21swapper/523:25:187
160889980,8cyclictest0-21swapper/523:25:187
160889980,8cyclictest0-21swapper/519:22:167
160889980,1cyclictest0-21swapper/523:20:197
160889980,1cyclictest0-21swapper/523:20:197
160849988,0cyclictest0-21swapper/422:50:126
160849987,1cyclictest0-21swapper/421:35:246
160849981,4cyclictest0-21swapper/420:20:246
160849980,8cyclictest0-21swapper/423:50:196
160849980,8cyclictest0-21swapper/421:45:226
160849980,8cyclictest0-21swapper/420:45:186
160849980,8cyclictest0-21swapper/420:25:256
160849980,8cyclictest0-21swapper/420:05:246
160849980,2cyclictest12897-21expr23:15:176
160849980,2cyclictest12897-21expr23:15:176
160849980,1cyclictest0-21swapper/422:15:196
160799987,1cyclictest0-21swapper/322:25:205
160799987,1cyclictest0-21swapper/321:30:165
160799987,1cyclictest0-21swapper/320:40:225
160799987,1cyclictest0-21swapper/320:20:255
160799987,1cyclictest0-21swapper/319:45:165
160799982,5cyclictest0-21swapper/323:49:595
160799982,5cyclictest0-21swapper/322:45:005
160799981,6cyclictest12810-21kworker/u24:220:10:005
160799980,8cyclictest0-21swapper/322:00:265
160799980,2cyclictest12341-21diskmemload23:29:365
160799980,2cyclictest12341-21diskmemload23:29:365
160799980,1cyclictest0-21swapper/300:18:015
160759987,1cyclictest0-21swapper/223:05:124
160759987,1cyclictest0-21swapper/221:55:234
160759987,1cyclictest0-21swapper/221:25:194
160759980,8cyclictest0-21swapper/223:55:174
160759980,8cyclictest0-21swapper/223:50:154
160759980,8cyclictest0-21swapper/223:25:134
160759980,8cyclictest0-21swapper/223:25:134
160759980,8cyclictest0-21swapper/223:15:194
160759980,8cyclictest0-21swapper/223:15:194
160759980,8cyclictest0-21swapper/222:55:254
160759980,8cyclictest0-21swapper/222:45:144
160759980,8cyclictest0-21swapper/222:30:254
160759980,8cyclictest0-21swapper/222:20:164
160759980,8cyclictest0-21swapper/222:00:164
160759980,8cyclictest0-21swapper/221:45:154
160759980,8cyclictest0-21swapper/221:40:164
160759980,8cyclictest0-21swapper/221:35:234
160759980,8cyclictest0-21swapper/221:30:174
160759980,8cyclictest0-21swapper/221:20:144
160759980,8cyclictest0-21swapper/220:30:174
160759980,8cyclictest0-21swapper/220:15:144
160759980,8cyclictest0-21swapper/220:00:164
160759980,8cyclictest0-21swapper/219:40:154
160759980,8cyclictest0-21swapper/219:35:154
160759980,8cyclictest0-21swapper/219:30:244
160759980,8cyclictest0-21swapper/200:25:174
160759980,8cyclictest0-21swapper/200:15:164
160759980,7cyclictest0-21swapper/222:51:334
160759980,7cyclictest0-21swapper/200:30:214
160759980,1cyclictest0-21swapper/223:40:144
160759980,1cyclictest0-21swapper/223:35:184
160759980,1cyclictest0-21swapper/221:50:164
160759980,1cyclictest0-21swapper/220:51:554
160759980,1cyclictest0-21swapper/219:50:434
160759980,1cyclictest0-21swapper/219:10:014
160759980,1cyclictest0-21swapper/200:05:154
160669987,1cyclictest0-21swapper/000:25:240
160669985,2cyclictest22351-21perl22:45:150
160669985,2cyclictest16945-21turbostat22:39:590
160669985,2cyclictest0-21swapper/021:00:180
160669983,4cyclictest0-21swapper/023:55:010
160669982,4cyclictest0-21swapper/020:45:170
160669980,8cyclictest0-21swapper/023:58:440
160669980,8cyclictest0-21swapper/022:43:010
160669980,1cyclictest0-21swapper/020:05:260
15378281,5sleep90-21swapper/919:05:3311
161189976,1cyclictest0-21swapper/1123:40:153
161189976,1cyclictest0-21swapper/1123:15:313
161189976,1cyclictest0-21swapper/1123:15:313
161189976,1cyclictest0-21swapper/1122:45:593
161189976,1cyclictest0-21swapper/1122:15:133
161189976,1cyclictest0-21swapper/1121:11:113
161189976,1cyclictest0-21swapper/1121:06:283
161189976,1cyclictest0-21swapper/1120:55:363
161189976,1cyclictest0-21swapper/1120:45:063
161189976,1cyclictest0-21swapper/1120:32:593
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional