You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-09 - 07:10
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot4.osadl.org (updated Fri Jan 09, 2026 00:45:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
123072232167,21sleep20-21swapper/219:06:492
124952205171,23sleep30-21swapper/319:09:073
122502202169,22sleep10-21swapper/119:06:041
124352201167,22sleep00-21swapper/019:08:200
3174321400,7sleep11285899cyclictest21:55:251
653921310,2sleep01285799cyclictest23:15:220
1286099650,25cyclictest0-21swapper/321:20:323
138491630,1ptp4l10214-21/usr/sbin/munin22:20:173
300052620,2sleep00-21swapper/000:05:010
259102620,1sleep30-21swapper/320:40:173
1285799581,11cyclictest3982-21sed21:00:180
1285799577,10cyclictest13397-21sed00:35:120
219172540,1sleep00-21swapper/021:35:260
1285799544,9cyclictest3705-21irqrtprio23:10:170
1285799544,9cyclictest11863-21grep20:10:230
1285799543,9cyclictest3133-21tr00:15:150
1285799534,9cyclictest25531-21cstates20:40:130
1285799534,10cyclictest19011-21tr19:20:210
1286099524,21cyclictest0-21swapper/322:27:523
1285799524,9cyclictest4305-21grep22:05:240
62882510,1sleep10-21swapper/121:05:181
138491500,39ptp4l0-21swapper/319:10:013
317162490,2sleep20-21swapper/223:00:242
270182490,1sleep30-21swapper/322:50:273
1286099490,4cyclictest24660-21runrttasks21:41:253
1285799491,16cyclictest21759-21awk22:40:240
1285799491,10cyclictest26700-21grep22:50:240
1285799485,15cyclictest9269-21ls22:15:240
1285799485,11cyclictest18675-21latency22:35:190
1285799484,10cyclictest23105-21expr22:45:150
1285799473,9cyclictest30108-21latency_hist20:50:010
1285799471,16cyclictest7641-21latency_hist00:25:000
1285799471,11cyclictest17612-21/usr/sbin/munin23:40:170
1285799471,11cyclictest17612-21/usr/sbin/munin23:40:170
1285799452,14cyclictest17779-21latency_hist19:20:000
1285799451,15cyclictest20020-21latency_hist21:35:000
12857994511,17cyclictest15104-21latency_hist20:20:000
1285799451,10cyclictest14235-21sed22:25:250
138491440,0ptp4l401ktimersoftd/323:17:323
1285799441,7cyclictest24317-21ls21:40:230
138491430,0ptp4l401ktimersoftd/322:40:203
138491430,0ptp4l401ktimersoftd/320:50:413
138491430,0ptp4l401ktimersoftd/320:50:403
1285799433,7cyclictest20855-21hddtemp_smartct20:30:170
1285799432,17cyclictest10475-21expr23:25:140
1285799431,13cyclictest10228-21apt-get22:20:110
1285799430,8cyclictest0-21swapper/021:55:150
138491420,0ptp4l401ktimersoftd/300:40:003
12860994236,4cyclictest24760-21cron23:55:013
1286099420,39cyclictest5034-21cron22:10:003
12858994231,9cyclictest25-21ksoftirqd/123:53:071
1285799423,7cyclictest5860-21hddtemp_smartct22:10:150
1285799420,7cyclictest15336-21apt-get21:25:110
1285799414,7cyclictest6037-21perl21:05:160
1285799410,7cyclictest1823-21ls22:00:250
1285799410,7cyclictest1823-21ls22:00:250
50798400,4rtkit-daemon7921-21apt-get21:10:111
12858994031,7cyclictest25-21ksoftirqd/122:25:011
1285799401,15cyclictest10161-21latency_hist20:10:000
138491390,0ptp4l401ktimersoftd/322:10:253
12858993933,4cyclictest25-21ksoftirqd/123:39:591
12858993933,3cyclictest25-21ksoftirqd/122:50:131
12858993933,3cyclictest25-21ksoftirqd/122:10:001
12858993933,3cyclictest25-21ksoftirqd/120:40:001
1285799391,8cyclictest18535-21iostat_ios20:25:170
1285799391,12cyclictest30523-21df_abs19:45:140
1286099380,19cyclictest0-21swapper/321:30:183
12858993834,2cyclictest25-21ksoftirqd/100:34:591
12858993833,3cyclictest25-21ksoftirqd/123:05:011
12858993833,3cyclictest25-21ksoftirqd/120:00:011
1285799383,13cyclictest26196-21irqstats21:45:190
12860993731,4cyclictest41-21ksoftirqd/321:13:393
12860993731,4cyclictest41-21ksoftirqd/320:39:213
12860993731,4cyclictest41-21ksoftirqd/300:32:043
12860993731,4cyclictest41-21ksoftirqd/300:22:243
1285999378,27cyclictest0-21swapper/223:20:032
12858993733,3cyclictest25-21ksoftirqd/122:05:001
12858993733,3cyclictest25-21ksoftirqd/122:05:001
12858993732,3cyclictest25-21ksoftirqd/123:10:011
12858993732,3cyclictest25-21ksoftirqd/120:10:001
12858993732,3cyclictest25-21ksoftirqd/119:50:001
12858993726,9cyclictest25-21ksoftirqd/119:35:131
1285799374,13cyclictest23649-21memory23:50:200
1285799372,8cyclictest223-21systemd-journal19:59:590
12860993630,4cyclictest41-21ksoftirqd/322:38:183
12860993630,4cyclictest41-21ksoftirqd/321:27:273
12860993630,4cyclictest41-21ksoftirqd/320:56:183
12860993630,4cyclictest41-21ksoftirqd/300:07:563
12859993630,4cyclictest33-21ksoftirqd/220:43:532
12859993630,4cyclictest33-21ksoftirqd/219:52:462
12859993629,5cyclictest33-21ksoftirqd/219:45:402
12858993631,3cyclictest25-21ksoftirqd/123:20:001
12858993631,3cyclictest25-21ksoftirqd/122:39:591
12858993631,3cyclictest25-21ksoftirqd/121:39:591
12858993631,3cyclictest25-21ksoftirqd/120:25:001
12858993631,3cyclictest25-21ksoftirqd/120:20:001
12858993631,3cyclictest25-21ksoftirqd/119:35:001
12860993529,4cyclictest41-21ksoftirqd/323:05:393
12860993529,4cyclictest41-21ksoftirqd/322:48:533
12860993529,4cyclictest41-21ksoftirqd/320:21:113
12860993529,4cyclictest41-21ksoftirqd/319:43:573
12860993529,4cyclictest41-21ksoftirqd/319:43:573
12860993528,5cyclictest41-21ksoftirqd/300:14:263
12860993520,12cyclictest41-21ksoftirqd/321:55:593
12859993530,3cyclictest33-21ksoftirqd/223:25:122
12859993530,3cyclictest33-21ksoftirqd/222:50:322
12859993529,4cyclictest33-21ksoftirqd/223:19:582
12859993529,4cyclictest33-21ksoftirqd/222:44:082
12859993529,4cyclictest33-21ksoftirqd/221:32:032
12859993529,4cyclictest33-21ksoftirqd/221:11:562
12859993529,4cyclictest33-21ksoftirqd/220:34:542
12859993528,4cyclictest33-21ksoftirqd/219:13:392
12858993531,3cyclictest25-21ksoftirqd/100:10:001
12858993531,2cyclictest25-21ksoftirqd/119:20:001
12858993530,3cyclictest25-21ksoftirqd/122:30:001
12858993530,3cyclictest25-21ksoftirqd/120:45:001
12858993530,3cyclictest25-21ksoftirqd/100:05:001
12858993529,4cyclictest25-21ksoftirqd/123:42:191
12858993529,4cyclictest25-21ksoftirqd/123:42:191
12858993529,4cyclictest25-21ksoftirqd/119:13:301
12858993529,4cyclictest25-21ksoftirqd/100:21:381
1285799353,5cyclictest8987-21meminfo00:25:210
12860993428,4cyclictest41-21ksoftirqd/323:46:153
12860993428,4cyclictest41-21ksoftirqd/323:12:293
12860993428,4cyclictest41-21ksoftirqd/322:18:093
12860993428,4cyclictest41-21ksoftirqd/321:39:253
12860993428,4cyclictest41-21ksoftirqd/321:16:033
12860993428,4cyclictest41-21ksoftirqd/319:58:013
12860993428,4cyclictest41-21ksoftirqd/300:28:223
12859993428,4cyclictest33-21ksoftirqd/222:58:362
12859993428,4cyclictest33-21ksoftirqd/220:21:592
12859993428,4cyclictest33-21ksoftirqd/200:13:302
12859993428,3cyclictest33-21ksoftirqd/221:29:222
12858993430,3cyclictest25-21ksoftirqd/120:30:191
12858993429,3cyclictest25-21ksoftirqd/122:44:591
12858993429,3cyclictest25-21ksoftirqd/121:51:091
12858993429,3cyclictest25-21ksoftirqd/100:29:591
12858993428,4cyclictest25-21ksoftirqd/123:21:581
12858993428,4cyclictest25-21ksoftirqd/120:01:201
12858993428,4cyclictest25-21ksoftirqd/100:37:361
12857993429,3cyclictest9-21ksoftirqd/019:40:000
1285799341,13cyclictest8572-21if_enp1s021:10:150
12860993328,3cyclictest41-21ksoftirqd/320:17:443
12860993328,3cyclictest41-21ksoftirqd/319:54:013
12860993327,4cyclictest41-21ksoftirqd/321:00:353
12860993327,4cyclictest41-21ksoftirqd/320:45:123
12860993327,4cyclictest41-21ksoftirqd/319:39:513
12860993313,17cyclictest15543-21sed22:30:133
1285999335,27cyclictest0-21swapper/219:44:232
1285999335,27cyclictest0-21swapper/219:44:232
12859993329,3cyclictest33-21ksoftirqd/221:23:192
12859993328,3cyclictest33-21ksoftirqd/222:27:132
12859993328,3cyclictest33-21ksoftirqd/221:08:052
12859993328,3cyclictest33-21ksoftirqd/200:30:182
12859993327,4cyclictest33-21ksoftirqd/222:12:222
12859993327,4cyclictest33-21ksoftirqd/221:48:482
12859993327,4cyclictest33-21ksoftirqd/220:39:442
12859993327,4cyclictest33-21ksoftirqd/220:13:122
12859993327,4cyclictest33-21ksoftirqd/219:32:082
12859993327,4cyclictest33-21ksoftirqd/200:16:032
12859993327,3cyclictest33-21ksoftirqd/223:10:042
12859993327,3cyclictest33-21ksoftirqd/221:40:082
12858993330,2cyclictest25-21ksoftirqd/121:20:191
12858993329,3cyclictest25-21ksoftirqd/122:15:191
12858993329,3cyclictest25-21ksoftirqd/121:20:011
12858993329,2cyclictest25-21ksoftirqd/119:25:181
12858993328,3cyclictest25-21ksoftirqd/123:55:131
12858993328,3cyclictest25-21ksoftirqd/121:45:181
12858993327,4cyclictest25-21ksoftirqd/123:26:551
12858993327,4cyclictest25-21ksoftirqd/122:14:381
12858993327,4cyclictest25-21ksoftirqd/120:49:521
12858993327,4cyclictest25-21ksoftirqd/119:42:341
12858993327,4cyclictest25-21ksoftirqd/119:42:331
12858993327,3cyclictest25-21ksoftirqd/123:10:181
12857993328,3cyclictest9-21ksoftirqd/023:00:010
12857993327,4cyclictest9-21ksoftirqd/021:52:230
12857993327,4cyclictest9-21ksoftirqd/020:59:230
12860993228,3cyclictest41-21ksoftirqd/319:25:103
12860993227,3cyclictest41-21ksoftirqd/323:55:453
12860993227,3cyclictest41-21ksoftirqd/300:01:343
12860993226,4cyclictest41-21ksoftirqd/323:44:093
12860993226,4cyclictest41-21ksoftirqd/323:44:093
12860993226,4cyclictest41-21ksoftirqd/322:03:013
12860993226,4cyclictest41-21ksoftirqd/322:03:013
12860993226,4cyclictest41-21ksoftirqd/320:05:513
12860993220,10cyclictest41-21ksoftirqd/323:30:393
1286099320,4cyclictest5568-21grep21:05:133
1286099320,3cyclictest223-21systemd-journal22:55:013
12859993228,2cyclictest33-21ksoftirqd/220:01:022
12859993227,3cyclictest33-21ksoftirqd/223:40:302
12859993227,3cyclictest33-21ksoftirqd/223:40:302
12859993227,3cyclictest33-21ksoftirqd/220:19:542
12859993227,3cyclictest33-21ksoftirqd/200:25:572
12859993226,4cyclictest33-21ksoftirqd/223:50:422
12859993226,4cyclictest33-21ksoftirqd/222:35:532
12859993226,4cyclictest33-21ksoftirqd/220:59:012
12859993226,4cyclictest33-21ksoftirqd/219:36:132
12859993226,4cyclictest33-21ksoftirqd/200:37:282
12858993228,2cyclictest25-21ksoftirqd/121:00:001
12858993228,2cyclictest25-21ksoftirqd/120:10:171
12858993227,3cyclictest25-21ksoftirqd/123:45:181
12858993227,3cyclictest25-21ksoftirqd/121:01:081
12858993227,3cyclictest25-21ksoftirqd/119:50:111
12858993226,4cyclictest25-21ksoftirqd/122:33:511
12858993226,4cyclictest25-21ksoftirqd/121:30:461
12858993226,4cyclictest25-21ksoftirqd/120:52:341
12858993226,4cyclictest25-21ksoftirqd/120:52:331
12857993227,3cyclictest9-21ksoftirqd/023:36:450
12857993226,4cyclictest9-21ksoftirqd/021:15:550
12857993226,4cyclictest9-21ksoftirqd/019:31:300
12857993226,4cyclictest9-21ksoftirqd/000:30:370
1286099310,3cyclictest30800-21cat19:45:173
12859993126,3cyclictest33-21ksoftirqd/223:36:072
12859993126,3cyclictest33-21ksoftirqd/222:01:432
12859993126,3cyclictest33-21ksoftirqd/222:01:432
12859993126,3cyclictest33-21ksoftirqd/220:52:172
12859993126,3cyclictest33-21ksoftirqd/220:52:172
12859993126,3cyclictest33-21ksoftirqd/200:09:192
12859993125,4cyclictest33-21ksoftirqd/223:30:412
12859993125,4cyclictest33-21ksoftirqd/223:05:492
12859993125,4cyclictest33-21ksoftirqd/221:52:252
12859993125,4cyclictest33-21ksoftirqd/221:37:002
12858993127,2cyclictest25-21ksoftirqd/121:40:161
12858993127,2cyclictest25-21ksoftirqd/100:15:191
12858993126,3cyclictest25-21ksoftirqd/122:49:591
12858993126,3cyclictest25-21ksoftirqd/119:20:121
12858993126,3cyclictest25-21ksoftirqd/100:10:471
1285899310,28cyclictest21126-21kworker/1:122:55:111
12857993125,4cyclictest9-21ksoftirqd/023:23:130
12857993125,4cyclictest9-21ksoftirqd/023:01:460
12857993125,4cyclictest9-21ksoftirqd/019:11:240
12857993124,4cyclictest9-21ksoftirqd/022:31:500
12860993025,3cyclictest41-21ksoftirqd/319:24:123
12860993024,4cyclictest41-21ksoftirqd/323:22:003
12860993024,4cyclictest41-21ksoftirqd/300:18:593
12860993012,15cyclictest1303-21runrttasks19:32:143
12860993011,16cyclictest12163-21seq23:26:453
12859993026,2cyclictest33-21ksoftirqd/200:00:462
12859993025,3cyclictest33-21ksoftirqd/222:32:592
12859993025,3cyclictest33-21ksoftirqd/220:45:012
12859993024,4cyclictest33-21ksoftirqd/222:24:422
12859993024,4cyclictest33-21ksoftirqd/220:25:322
12859993024,4cyclictest33-21ksoftirqd/219:23:462
12858993025,3cyclictest25-21ksoftirqd/121:25:181
12857993025,3cyclictest9-21ksoftirqd/023:56:130
12857993025,3cyclictest9-21ksoftirqd/021:22:340
12857993024,4cyclictest9-21ksoftirqd/019:54:130
12860992923,4cyclictest41-21ksoftirqd/320:31:103
12860992923,4cyclictest41-21ksoftirqd/320:26:013
12860992911,15cyclictest30382-21cstates23:00:123
1285999294,23cyclictest0-21swapper/219:16:532
12859992924,3cyclictest33-21ksoftirqd/223:45:552
12859992924,3cyclictest33-21ksoftirqd/221:18:302
12859992924,3cyclictest33-21ksoftirqd/221:02:322
12859992924,3cyclictest33-21ksoftirqd/219:27:292
12858992924,3cyclictest25-21ksoftirqd/120:25:171
12858992918,10cyclictest25-21ksoftirqd/123:30:241
12857992923,4cyclictest9-21ksoftirqd/020:53:300
12857992923,4cyclictest9-21ksoftirqd/020:53:300
1285799290,8cyclictest28147-21df_inode19:40:140
1285799290,8cyclictest28147-21df_inode19:40:140
1286099286,19cyclictest7072-21timerandwakeup20:00:243
12860992822,4cyclictest41-21ksoftirqd/323:38:563
1286099281,21cyclictest27659-21apt-get21:50:123
12860992811,15cyclictest10732-21cat20:10:123
1286099280,26cyclictest0-21swapper/321:49:593
12859992823,3cyclictest33-21ksoftirqd/222:08:122
12859992823,3cyclictest33-21ksoftirqd/219:55:152
12859992822,4cyclictest33-21ksoftirqd/221:57:222
12859992822,4cyclictest33-21ksoftirqd/220:08:272
12857992822,4cyclictest9-21ksoftirqd/020:21:120
1285799281,10cyclictest7707-21latency_hist20:05:010
1285799280,7cyclictest21749-21ls23:45:250
1286099270,1cyclictest15348-21apt-get19:15:133
12859992721,4cyclictest33-21ksoftirqd/200:22:572
12857992621,3cyclictest9-21ksoftirqd/000:11:030
12857992619,4cyclictest9-21ksoftirqd/019:26:080
12859992520,3cyclictest33-21ksoftirqd/222:45:102
1285799253,9cyclictest9-21ksoftirqd/023:05:160
1285799252,7cyclictest28066-21hddtemp_smartct00:00:150
12859992418,4cyclictest33-21ksoftirqd/222:16:232
12857992419,3cyclictest9-21ksoftirqd/020:38:070
12857992418,4cyclictest9-21ksoftirqd/023:31:030
12859992318,3cyclictest33-21ksoftirqd/223:59:572
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional