You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-09 - 23:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot8s.osadl.org (updated Tue Dec 09, 2025 12:44:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
275991830,74ptp4l0-21swapper/107:05:221
185326856,10sleep50-21swapper/507:05:497
214726755,10sleep40-21swapper/407:09:496
184526755,10sleep100-21swapper/1007:05:432
208426655,9sleep110-21swapper/1107:09:093
208026555,8sleep70-21swapper/707:09:059
191826554,9sleep00-21swapper/007:06:460
206426453,9sleep60-21swapper/607:08:518
221542620,0sleep00-21swapper/012:25:200
92852590,0sleep110-21swapper/1107:55:253
88392590,0sleep100-21swapper/1007:55:242
283102590,0sleep90-21swapper/908:20:2511
54232540,0sleep30-21swapper/307:10:235
248999204,10cyclictest0-21swapper/210:50:014
249799191,17cyclictest0-21swapper/312:00:155
253799180,17cyclictest0-21swapper/1110:50:173
252899181,16cyclictest0-21swapper/909:05:2411
252899180,16cyclictest0-21swapper/911:15:2011
275991170,0ptp4l0-21swapper/112:05:131
252899174,8cyclictest0-21swapper/911:30:2311
252899172,9cyclictest0-21swapper/908:00:0111
252499174,7cyclictest0-21swapper/812:25:2610
251099170,16cyclictest0-21swapper/507:40:207
247999174,8cyclictest0-21swapper/012:35:010
2479991716,1cyclictest0-21swapper/010:10:000
304022160,0sleep00-21swapper/011:14:590
275991160,0ptp4l0-21swapper/111:10:161
253799163,8cyclictest0-21swapper/1110:45:003
252499160,2cyclictest0-21swapper/807:45:1610
250599163,8cyclictest0-21swapper/409:55:246
247999163,8cyclictest0-21swapper/008:05:010
247999161,10cyclictest11388-21kworker/u24:108:30:000
247999160,10cyclictest0-21swapper/007:15:240
116632160,1sleep3321rcuc/310:50:005
60382150,0sleep20-21swapper/209:15:254
275991150,1ptp4l21-21ksoftirqd/110:05:301
275991150,1ptp4l21-21ksoftirqd/109:55:251
275991150,0ptp4l0-21swapper/111:20:281
275991150,0ptp4l0-21swapper/110:50:171
275991150,0ptp4l0-21swapper/109:50:151
275991150,0ptp4l0-21swapper/109:15:211
253799150,3cyclictest0-21swapper/1107:30:163
252899152,8cyclictest0-21swapper/911:55:0011
252899152,8cyclictest0-21swapper/907:40:0111
252499152,9cyclictest11388-21kworker/u24:109:35:0010
252499152,9cyclictest0-21swapper/810:05:0010
251099151,3cyclictest0-21swapper/510:25:197
249799153,7cyclictest0-21swapper/312:40:015
248599153,7cyclictest0-21swapper/110:05:001
247999153,8cyclictest0-21swapper/007:40:000
247999152,8cyclictest0-21swapper/011:55:000
247999152,7cyclictest0-21swapper/008:25:010
102072150,0sleep110-21swapper/1110:05:153
275991140,2ptp4l5532-21grep07:50:231
275991140,0ptp4l0-21swapper/107:10:181
252899142,7cyclictest0-21swapper/908:40:0111
252899141,7cyclictest0-21swapper/908:55:0011
251999143,7cyclictest0-21swapper/709:19:309
251099141,8cyclictest0-21swapper/512:05:007
250599142,7cyclictest0-21swapper/412:25:006
249799142,8cyclictest0-21swapper/307:25:015
249799142,7cyclictest0-21swapper/312:00:015
249799142,7cyclictest0-21swapper/309:15:005
249799142,7cyclictest0-21swapper/308:15:015
249799140,8cyclictest0-21swapper/310:40:005
249799140,8cyclictest0-21swapper/310:15:005
248999143,7cyclictest0-21swapper/207:35:254
247999143,7cyclictest0-21swapper/008:00:010
235262140,0sleep70-21swapper/710:20:259
275991130,5ptp4l0-21swapper/108:10:141
275991130,1ptp4l21-21ksoftirqd/109:22:021
275991130,1ptp4l21-21ksoftirqd/108:01:041
275991130,0ptp4l0-21swapper/107:30:241
253799133,6cyclictest0-21swapper/1107:50:013
253799132,7cyclictest0-21swapper/1110:00:003
253399131,7cyclictest0-21swapper/1012:20:212
252899132,6cyclictest0-21swapper/912:40:0011
252499132,7cyclictest0-21swapper/808:45:0110
252499131,9cyclictest11388-21kworker/u24:108:10:0010
251999133,7cyclictest0-21swapper/708:20:019
251999133,6cyclictest0-21swapper/712:00:239
251999132,6cyclictest0-21swapper/710:50:009
251599131,7cyclictest0-21swapper/611:35:008
250599132,7cyclictest0-21swapper/407:50:216
249799133,7cyclictest0-21swapper/309:05:005
249799133,6cyclictest0-21swapper/311:50:275
248599134,5cyclictest0-21swapper/109:15:001
247999133,6cyclictest0-21swapper/010:25:000
247999132,7cyclictest0-21swapper/009:40:280
247999131,8cyclictest0-21swapper/009:05:010
323622121,8sleep80-21swapper/807:05:1710
275991120,5ptp4l21-21ksoftirqd/112:30:231
275991120,3ptp4l8664-21latency_hist08:40:011
275991120,1ptp4l21-21ksoftirqd/112:15:121
275991120,1ptp4l21-21ksoftirqd/109:25:241
275991120,0ptp4l0-21swapper/112:02:301
275991120,0ptp4l0-21swapper/111:45:221
275991120,0ptp4l0-21swapper/111:15:491
275991120,0ptp4l0-21swapper/107:27:251
253799122,7cyclictest0-21swapper/1109:05:003
253799121,7cyclictest0-21swapper/1110:55:283
253799120,11cyclictest0-21swapper/1110:04:543
253399122,6cyclictest0-21swapper/1011:20:002
253399122,6cyclictest0-21swapper/1011:00:012
253399120,7cyclictest0-21swapper/1010:05:002
252899121,7cyclictest11388-21kworker/u24:112:20:0111
252499121,7cyclictest0-21swapper/810:45:2610
252499121,6cyclictest0-21swapper/812:15:0010
251999123,8cyclictest0-21swapper/712:15:019
251999122,8cyclictest0-21swapper/707:45:019
251099122,6cyclictest0-21swapper/511:35:017
251099122,6cyclictest0-21swapper/511:25:277
251099121,7cyclictest0-21swapper/509:30:017
248999123,6cyclictest0-21swapper/209:40:014
247999122,6cyclictest0-21swapper/011:45:010
247999121,6cyclictest0-21swapper/011:39:590
275991110,5ptp4l0-21swapper/110:28:131
275991110,4ptp4l21-21ksoftirqd/111:00:011
275991110,2ptp4l28950-21perl12:35:131
275991110,2ptp4l26539-21latency_hist11:10:001
275991110,2ptp4l25922-21memory09:00:181
275991110,2ptp4l16649-21perl10:55:181
275991110,1ptp4l0-21swapper/111:40:191
275991110,0ptp4l0-21swapper/111:25:171
275991110,0ptp4l0-21swapper/110:40:161
275991110,0ptp4l0-21swapper/109:40:251
275991110,0ptp4l0-21swapper/108:50:241
275991110,0ptp4l0-21swapper/108:30:241
275991110,0ptp4l0-21swapper/107:40:231
253799111,6cyclictest0-21swapper/1111:30:003
253799110,7cyclictest0-21swapper/1112:20:013
253399112,5cyclictest0-21swapper/1011:05:242
252899113,6cyclictest0-21swapper/907:45:2311
251999112,7cyclictest0-21swapper/707:50:009
251599112,5cyclictest0-21swapper/611:40:248
251599111,5cyclictest0-21swapper/611:50:018
251599110,10cyclictest7125-21irqrtprio10:00:188
251599110,10cyclictest2892-21hddtemp_smartct09:55:168
251099111,7cyclictest0-21swapper/510:55:017
249799110,2cyclictest6976-21fw_conntrack07:15:015
248999112,6cyclictest0-21swapper/211:45:004
248999112,6cyclictest0-21swapper/208:35:234
248999112,6cyclictest0-21swapper/208:15:254
248999111,6cyclictest6814-21memory07:15:004
248599112,6cyclictest0-21swapper/112:00:011
248599110,6cyclictest0-21swapper/107:35:011
275991100,4ptp4l21-21ksoftirqd/108:49:411
275991100,2ptp4l9867-21cat08:40:151
275991100,2ptp4l30028-21/usr/sbin/munin10:30:161
275991100,2ptp4l17041-21ps09:30:211
275991100,2ptp4l14856-21df11:35:131
275991100,1ptp4l8263-21sed07:55:191
275991100,1ptp4l22521-21df_inode08:15:151
275991100,1ptp4l0-21swapper/109:35:161
275991100,1ptp4l0-21swapper/109:00:011
275991100,0ptp4l0-21swapper/112:20:211
275991100,0ptp4l0-21swapper/110:36:431
275991100,0ptp4l0-21swapper/110:10:261
275991100,0ptp4l0-21swapper/107:15:171
253799100,9cyclictest0-21swapper/1109:30:263
253399107,2cyclictest28045-21grep11:10:132
253399102,5cyclictest0-21swapper/1010:40:002
252899100,9cyclictest0-21swapper/909:35:1511
252499107,2cyclictest0-21swapper/810:29:5810
252499100,9cyclictest0-21swapper/810:20:2010
252499100,2cyclictest0-21swapper/809:10:1710
251999102,6cyclictest0-21swapper/710:20:009
251599106,3cyclictest2664-21basename09:15:008
251599102,6cyclictest0-21swapper/611:15:008
251599102,5cyclictest0-21swapper/608:15:008
251599100,9cyclictest0-21swapper/608:05:218
249799107,2cyclictest9715-21turbostat11:29:595
249799100,9cyclictest0-21swapper/308:55:165
248599102,5cyclictest0-21swapper/108:05:001
9498090,5rtkit-daemon0-21swapper/307:07:535
32479291,6sleep90-21swapper/907:05:1811
27599190,1ptp4l21-21ksoftirqd/112:25:151
27599190,1ptp4l21-21ksoftirqd/110:15:011
27599190,1ptp4l21-21ksoftirqd/109:45:151
27599190,0ptp4l0-21swapper/112:10:191
27599190,0ptp4l0-21swapper/111:50:161
27599190,0ptp4l0-21swapper/111:30:121
27599190,0ptp4l0-21swapper/110:45:151
27599190,0ptp4l0-21swapper/110:20:141
27599190,0ptp4l0-21swapper/109:05:191
27599190,0ptp4l0-21swapper/108:25:001
27599190,0ptp4l0-21swapper/108:20:011
27599190,0ptp4l0-21swapper/107:45:121
27599190,0ptp4l0-21swapper/107:20:121
25379998,1cyclictest0-21swapper/1110:20:013
25379992,6cyclictest0-21swapper/1109:10:003
25379990,8cyclictest0-21swapper/1112:10:003
25379990,2cyclictest11241-21awk10:49:593
25379990,1cyclictest0-21swapper/1108:00:143
25339991,5cyclictest0-21swapper/1009:40:012
25339990,9cyclictest0-21swapper/1009:50:132
25339990,9cyclictest0-21swapper/1008:10:172
25339990,1cyclictest0-21swapper/1010:30:242
25339990,1cyclictest0-21swapper/1008:25:112
25289997,1cyclictest0-21swapper/908:10:1511
25289996,2cyclictest11782-21irqrtprio08:00:1911
25289991,5cyclictest0-21swapper/911:30:0011
25289990,9cyclictest0-21swapper/910:05:1611
25289990,9cyclictest0-21swapper/909:25:1911
25289990,1cyclictest0-21swapper/907:40:2011
25249998,1cyclictest0-21swapper/811:00:2610
25249990,4cyclictest0-21swapper/807:25:0010
25249990,2cyclictest31154-21diskmemload11:58:2010
25249990,1cyclictest0-21swapper/807:15:2010
25199990,8cyclictest0-21swapper/708:35:139
25159998,1cyclictest0-21swapper/608:20:268
25159994,5cyclictest0-21swapper/607:19:568
25159991,5cyclictest0-21swapper/609:35:268
25159991,5cyclictest0-21swapper/609:25:018
25159991,5cyclictest0-21swapper/607:40:018
25159990,1cyclictest0-21swapper/612:00:238
25109998,1cyclictest0-21swapper/508:35:127
25109991,5cyclictest0-21swapper/512:05:237
25109991,5cyclictest0-21swapper/510:39:597
25109991,5cyclictest0-21swapper/509:10:017
25109991,5cyclictest0-21swapper/507:10:017
25059996,2cyclictest21717-21/usr/sbin/munin11:00:226
25059992,4cyclictest0-21swapper/410:50:006
25059990,1cyclictest0-21swapper/410:25:216
24979998,1cyclictest0-21swapper/307:40:145
24979997,1cyclictest0-21swapper/308:20:005
24899992,5cyclictest0-21swapper/207:35:004
24899991,5cyclictest2472-21cyclictest09:15:014
24899990,8cyclictest30815-21if_p34p111:55:184
24899990,8cyclictest11165-21cut10:05:204
24899990,5cyclictest0-21swapper/211:45:004
24899990,3cyclictest621-21tail11:15:234
24899990,2cyclictest19556-21cut08:10:194
16949290,0sleep100-21swapper/1008:05:242
25379982,3cyclictest0-21swapper/1110:10:273
25379980,2cyclictest31154-21diskmemload09:47:033
25379980,1cyclictest0-21swapper/1112:30:263
25379980,1cyclictest0-21swapper/1111:45:253
25339987,1cyclictest0-21swapper/1011:55:252
25339987,1cyclictest0-21swapper/1009:00:232
25339980,8cyclictest0-21swapper/1008:55:172
25339980,1cyclictest0-21swapper/1010:20:262
25339980,1cyclictest0-21swapper/1009:25:142
25339980,1cyclictest0-21swapper/1008:20:192
25289987,1cyclictest0-21swapper/912:05:1411
25289987,1cyclictest0-21swapper/909:20:2111
25289980,8cyclictest0-21swapper/912:03:3011
25289980,8cyclictest0-21swapper/911:45:2411
25289980,8cyclictest0-21swapper/911:20:1811
25289980,8cyclictest0-21swapper/909:30:1711
25289980,8cyclictest0-21swapper/909:15:1511
25289980,1cyclictest2254-21if_err_enp1s0.108:30:1911
25249987,1cyclictest0-21swapper/808:30:2110
25249980,8cyclictest0-21swapper/812:10:2010
25249980,8cyclictest0-21swapper/808:15:2010
25249980,1cyclictest0-21swapper/809:20:3110
25249980,1cyclictest0-21swapper/808:25:1310
25199980,1cyclictest0-21swapper/711:40:269
25199980,1cyclictest0-21swapper/707:55:169
25159987,1cyclictest0-21swapper/612:30:168
25159986,1cyclictest0-21swapper/612:40:008
25159981,5cyclictest0-21swapper/611:55:018
25159980,8cyclictest0-21swapper/611:20:158
25159980,8cyclictest0-21swapper/610:20:158
25159980,7cyclictest31154-21diskmemload11:15:018
25159980,1cyclictest0-21swapper/610:30:248
25159980,1cyclictest0-21swapper/608:49:428
25109987,1cyclictest0-21swapper/509:05:327
25109981,4cyclictest0-21swapper/512:10:317
25109981,4cyclictest0-21swapper/507:40:017
25109980,8cyclictest0-21swapper/511:45:287
25109980,8cyclictest0-21swapper/511:10:127
25109980,1cyclictest0-21swapper/511:20:157
25109980,1cyclictest0-21swapper/511:05:217
25059987,1cyclictest0-21swapper/411:00:006
25059987,1cyclictest0-21swapper/408:05:256
25059985,2cyclictest2023-21head08:30:186
25059981,2cyclictest0-21swapper/412:13:586
25059980,8cyclictest0-21swapper/412:35:146
25059980,1cyclictest0-21swapper/411:55:256
24979987,1cyclictest0-21swapper/311:10:155
24979987,1cyclictest0-21swapper/309:50:145
24979986,1cyclictest0-21swapper/308:00:155
24979983,4cyclictest0-21swapper/308:35:015
24979983,4cyclictest0-21swapper/307:30:015
24979980,1cyclictest0-21swapper/310:55:015
24979980,1cyclictest0-21swapper/310:40:235
24899987,1cyclictest0-21swapper/209:00:124
24899985,2cyclictest0-21swapper/209:05:254
24899981,5cyclictest0-21swapper/209:50:014
24899980,8cyclictest0-21swapper/209:45:184
24899980,8cyclictest0-21swapper/207:20:124
24899980,7cyclictest353-21memory07:45:194
24899980,7cyclictest20547-21cpuspeed_turbos12:25:134
24899980,3cyclictest18410-21/usr/sbin/munin12:20:194
24899980,2cyclictest7896-21/usr/sbin/munin10:00:204
24899980,2cyclictest21338-21/usr/sbin/munin11:00:204
24899980,1cyclictest15822-21fschecks_time09:30:164
24899980,1cyclictest0-21swapper/212:10:234
24899980,1cyclictest0-21swapper/210:45:014
24899980,1cyclictest0-21swapper/210:35:274
24799987,1cyclictest0-21swapper/010:10:140
24799980,8cyclictest0-21swapper/011:05:250
24799980,3cyclictest0-21swapper/009:35:000
24799980,1cyclictest0-21swapper/007:50:190
13014280,0sleep70-21swapper/710:50:169
27609170,6phc2sys0-21swapper/209:40:114
25379976,1cyclictest0-21swapper/1112:20:073
25379976,1cyclictest0-21swapper/1112:01:023
25379976,1cyclictest0-21swapper/1111:56:043
25379976,1cyclictest0-21swapper/1111:40:283
25379976,1cyclictest0-21swapper/1111:30:473
25379976,1cyclictest0-21swapper/1111:05:343
25379976,1cyclictest0-21swapper/1111:00:583
25379976,1cyclictest0-21swapper/1110:25:193
25379976,1cyclictest0-21swapper/1109:50:133
25379976,1cyclictest0-21swapper/1109:40:253
25379976,1cyclictest0-21swapper/1109:37:063
25379976,1cyclictest0-21swapper/1109:20:233
25379976,1cyclictest0-21swapper/1108:58:463
25379976,1cyclictest0-21swapper/1108:50:333
25379976,1cyclictest0-21swapper/1108:35:173
25379976,1cyclictest0-21swapper/1108:25:193
25379976,1cyclictest0-21swapper/1108:10:533
25379976,1cyclictest0-21swapper/1108:05:133
25379976,1cyclictest0-21swapper/1107:15:153
25379976,1cyclictest0-21swapper/1107:13:123
25379974,2cyclictest12760-21fschecks_time07:20:163
25379974,2cyclictest1020-21runrttasks10:20:563
25379970,7cyclictest0-21swapper/1112:10:373
25379970,7cyclictest0-21swapper/1111:50:363
25379970,7cyclictest0-21swapper/1109:25:353
25379970,7cyclictest0-21swapper/1109:10:433
25379970,7cyclictest0-21swapper/1108:40:143
25379970,7cyclictest0-21swapper/1108:19:223
25379970,7cyclictest0-21swapper/1107:50:153
25379970,7cyclictest0-21swapper/1107:41:213
25379970,7cyclictest0-21swapper/1107:35:253
25379970,7cyclictest0-21swapper/1107:25:203
25379970,1cyclictest0-21swapper/1112:37:573
25379970,1cyclictest0-21swapper/1112:26:453
25379970,1cyclictest0-21swapper/1111:35:313
25379970,1cyclictest0-21swapper/1111:22:293
25379970,1cyclictest0-21swapper/1111:17:453
25379970,1cyclictest0-21swapper/1111:11:023
25379970,1cyclictest0-21swapper/1110:37:013
25379970,1cyclictest0-21swapper/1110:31:373
25379970,1cyclictest0-21swapper/1109:18:103
25379970,1cyclictest0-21swapper/1108:45:043
25379970,1cyclictest0-21swapper/1108:32:523
25379970,1cyclictest0-21swapper/1108:24:133
25339976,1cyclictest0-21swapper/1012:30:102
25339976,1cyclictest0-21swapper/1012:10:282
25339976,1cyclictest0-21swapper/1012:05:542
25339976,1cyclictest0-21swapper/1011:35:212
25339976,1cyclictest0-21swapper/1011:20:112
25339976,1cyclictest0-21swapper/1010:50:392
25339976,1cyclictest0-21swapper/1010:15:152
25339976,1cyclictest0-21swapper/1009:21:172
25339976,1cyclictest0-21swapper/1009:10:122
25339976,1cyclictest0-21swapper/1008:35:172
25339976,1cyclictest0-21swapper/1008:00:062
25339976,1cyclictest0-21swapper/1007:30:102
25339976,1cyclictest0-21swapper/1007:25:242
25339974,2cyclictest7325-21fschecks_count11:25:162
25339974,2cyclictest3811-21unixbench-2d12:00:242
25339970,7cyclictest0-21swapper/1012:26:222
25339970,7cyclictest0-21swapper/1012:16:102
25339970,7cyclictest0-21swapper/1011:51:262
25339970,7cyclictest0-21swapper/1011:45:072
25339970,7cyclictest0-21swapper/1011:00:312
25339970,7cyclictest0-21swapper/1010:40:112
25339970,7cyclictest0-21swapper/1010:26:062
25339970,7cyclictest0-21swapper/1010:05:002
25339970,7cyclictest0-21swapper/1009:30:272
25339970,7cyclictest0-21swapper/1009:15:272
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional