You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-05 - 04:09
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackdslot3.osadl.org (updated Tue May 05, 2026 00:45:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
249282226163,20sleep20-21swapper/219:09:142
139491207173,22phc2sys0-21swapper/319:07:513
248602202169,22sleep10-21swapper/119:08:211
248542200167,22sleep00-21swapper/019:08:150
3198521640,5sleep12528099cyclictest21:40:001
25279996228,4cyclictest9-21ksoftirqd/020:00:000
25280996113,11cyclictest16357-21sed23:20:181
25279996129,6cyclictest9-21ksoftirqd/019:20:280
296982600,2sleep10-21swapper/120:25:181
2528099590,18cyclictest0-21swapper/120:00:251
25279995925,5cyclictest9-21ksoftirqd/023:05:000
25279995924,5cyclictest9-21ksoftirqd/023:15:000
25279995923,8cyclictest9-21ksoftirqd/021:40:020
326652580,2sleep10-21swapper/119:25:131
25279995828,4cyclictest9-21ksoftirqd/019:30:010
25279995825,4cyclictest9-21ksoftirqd/021:35:010
25279995825,4cyclictest9-21ksoftirqd/020:35:000
25279995822,7cyclictest9-21ksoftirqd/022:15:210
25279995822,5cyclictest9-21ksoftirqd/000:40:010
25279995722,7cyclictest9-21ksoftirqd/023:20:260
25279995624,5cyclictest9-21ksoftirqd/022:10:140
25279995622,4cyclictest9-21ksoftirqd/000:10:000
25279995621,6cyclictest9-21ksoftirqd/022:35:130
25279995620,7cyclictest9-21ksoftirqd/023:50:170
25279995620,5cyclictest9-21ksoftirqd/020:20:240
25282995522,5cyclictest41-21ksoftirqd/300:15:193
2528099550,12cyclictest4801-21cat00:05:001
25279995523,4cyclictest9-21ksoftirqd/000:10:220
25279995523,4cyclictest9-21ksoftirqd/000:10:220
25279995522,6cyclictest9-21ksoftirqd/021:55:160
25279995520,8cyclictest9-21ksoftirqd/019:10:240
25279995519,7cyclictest9-21ksoftirqd/019:35:160
25279995519,6cyclictest9-21ksoftirqd/019:40:150
25279995518,8cyclictest9-21ksoftirqd/022:30:240
25279995518,7cyclictest9-21ksoftirqd/021:25:190
25279995518,7cyclictest9-21ksoftirqd/021:25:190
2528099540,17cyclictest0-21swapper/121:05:301
25279995422,3cyclictest9-21ksoftirqd/023:30:180
25279995421,8cyclictest9-21ksoftirqd/022:25:280
25279995421,6cyclictest9-21ksoftirqd/022:05:220
25279995420,6cyclictest9-21ksoftirqd/022:55:190
25279995420,6cyclictest9-21ksoftirqd/020:00:190
25279995420,5cyclictest9-21ksoftirqd/021:40:010
25279995420,10cyclictest9-21ksoftirqd/021:10:230
25279995419,7cyclictest9-21ksoftirqd/020:59:590
25279995419,6cyclictest9-21ksoftirqd/022:20:190
25279995419,4cyclictest9-21ksoftirqd/019:35:010
25279995418,6cyclictest9-21ksoftirqd/023:15:220
25279995417,9cyclictest9-21ksoftirqd/020:35:180
2528299535,7cyclictest6307-21df_abs23:00:153
2528299534,7cyclictest15297-21latency_hist21:05:013
2528099530,11cyclictest27040-21cut20:20:181
25279995320,8cyclictest9-21ksoftirqd/021:00:170
25279995320,6cyclictest9-21ksoftirqd/023:35:220
25279995320,6cyclictest9-21ksoftirqd/000:00:190
25279995320,5cyclictest9-21ksoftirqd/021:05:250
25279995320,5cyclictest9-21ksoftirqd/020:25:180
25279995320,4cyclictest9-21ksoftirqd/023:05:200
25279995318,7cyclictest9-21ksoftirqd/022:40:240
25279995318,7cyclictest9-21ksoftirqd/022:40:230
25279995318,7cyclictest9-21ksoftirqd/019:15:230
25279995318,6cyclictest9-21ksoftirqd/021:45:240
25279995318,4cyclictest9-21ksoftirqd/000:20:110
25282995215,5cyclictest41-21ksoftirqd/320:00:263
2528099523,12cyclictest28122-21irqrtprio21:30:181
2528099520,17cyclictest0-21swapper/123:09:571
2528099520,17cyclictest0-21swapper/122:35:241
2528099520,16cyclictest0-21swapper/119:22:561
2528099520,12cyclictest6188-21cstates23:00:151
25279995222,5cyclictest9-21ksoftirqd/019:45:150
25279995220,5cyclictest9-21ksoftirqd/022:50:150
25279995220,3cyclictest9-21ksoftirqd/022:00:220
25279995219,4cyclictest9-21ksoftirqd/000:25:190
25279995218,6cyclictest9-21ksoftirqd/023:45:000
25279995218,4cyclictest9-21ksoftirqd/023:50:000
25279995216,7cyclictest9-21ksoftirqd/021:15:250
25279995216,4cyclictest9-21ksoftirqd/020:40:230
2528299512,5cyclictest26900-21hostname22:35:143
25282995112,5cyclictest41-21ksoftirqd/319:10:213
2528099510,12cyclictest19839-21if_enp1s022:20:171
2528099510,12cyclictest1204-21/usr/sbin/munin20:35:181
2528099510,11cyclictest848-21cut21:40:181
2528099510,11cyclictest3602-21cat19:30:201
2528099510,11cyclictest18737-21cut23:25:201
2528099510,11cyclictest12278-21/usr/sbin/munin00:20:121
25279995120,6cyclictest9-21ksoftirqd/021:20:220
25279995120,5cyclictest9-21ksoftirqd/020:10:190
25279995119,6cyclictest9-21ksoftirqd/020:50:200
25279995119,5cyclictest9-21ksoftirqd/020:45:180
25279995118,9cyclictest9-21ksoftirqd/000:30:230
25279995118,7cyclictest9-21ksoftirqd/020:15:270
25279995117,6cyclictest9-21ksoftirqd/020:10:000
25279995116,6cyclictest9-21ksoftirqd/000:15:230
2528299506,7cyclictest16556-21sed21:05:233
2528199506,9cyclictest33-21ksoftirqd/220:35:012
2528099502,16cyclictest19235-21grep20:05:141
2528099502,14cyclictest10789-21apt-get20:55:131
2528099500,9cyclictest23659-21awk20:14:591
2528099500,17cyclictest8652-21mailstats19:40:231
2528099500,17cyclictest31199-21apt-get22:45:121
2528099500,12cyclictest9909-21cat20:50:271
2528099500,12cyclictest4667-21cat21:50:001
2528099500,11cyclictest4130-21fschecks_count20:40:141
25279995021,5cyclictest9-21ksoftirqd/023:55:170
25279995020,6cyclictest9-21ksoftirqd/022:45:150
25279995020,4cyclictest9-21ksoftirqd/019:50:140
25279995019,5cyclictest9-21ksoftirqd/023:25:270
25279995017,5cyclictest9-21ksoftirqd/021:50:180
2528299495,7cyclictest305-21expr19:25:133
2528199494,8cyclictest33-21ksoftirqd/222:20:212
2528199493,9cyclictest33-21ksoftirqd/221:25:382
2528199493,9cyclictest33-21ksoftirqd/221:25:382
2528199493,6cyclictest33-21ksoftirqd/223:50:122
2528199493,6cyclictest33-21ksoftirqd/222:15:142
2528099490,17cyclictest22996-21df_abs21:20:141
2528099490,11cyclictest29243-21grep22:40:131
2528099490,11cyclictest29243-21grep22:40:131
2528299486,5cyclictest41-21ksoftirqd/320:06:463
2528299481,12cyclictest21505-21chrt00:39:463
2528199485,7cyclictest33-21ksoftirqd/219:35:202
2528199482,5cyclictest33-21ksoftirqd/200:25:262
2528099481,15cyclictest31057-21apt-get20:30:111
2528099480,16cyclictest0-21swapper/122:11:081
2528199479,5cyclictest33-21ksoftirqd/220:05:272
2528199479,4cyclictest33-21ksoftirqd/222:10:002
2528199477,5cyclictest33-21ksoftirqd/220:00:262
2528199475,9cyclictest33-21ksoftirqd/223:55:232
2528199475,3cyclictest33-21ksoftirqd/221:55:202
2528199474,9cyclictest33-21ksoftirqd/223:30:252
2528199473,6cyclictest33-21ksoftirqd/221:40:272
2528199473,5cyclictest33-21ksoftirqd/200:35:222
2528199472,6cyclictest33-21ksoftirqd/222:55:252
2528199472,5cyclictest33-21ksoftirqd/220:25:202
25281994717,28cyclictest12009-21kworker/2:000:30:242
2528199470,9cyclictest33-21ksoftirqd/223:45:262
2528199470,6cyclictest33-21ksoftirqd/219:33:442
2528099471,13cyclictest29974-21apt-get23:50:111
2528299464,6cyclictest24185-21tr23:35:243
2528199463,5cyclictest33-21ksoftirqd/223:00:142
2528199463,5cyclictest33-21ksoftirqd/200:20:152
2528099460,7cyclictest9277-21users00:10:271
2528099460,7cyclictest9277-21users00:10:261
2528099460,14cyclictest7190-21apt-get21:55:121
25282994528,6cyclictest41-21ksoftirqd/322:50:223
25282994516,6cyclictest41-21ksoftirqd/319:55:213
2528299451,12cyclictest18384-21grep22:15:233
2528299450,19cyclictest10443-21chrt20:53:493
2528199454,3cyclictest33-21ksoftirqd/219:20:192
2528199453,6cyclictest33-21ksoftirqd/219:10:262
2528199451,6cyclictest33-21ksoftirqd/220:58:352
2528199451,5cyclictest33-21ksoftirqd/223:05:192
2528199451,5cyclictest33-21ksoftirqd/221:20:262
2528199451,5cyclictest33-21ksoftirqd/219:15:272
2528199451,5cyclictest33-21ksoftirqd/200:05:202
2528099450,9cyclictest3593-21apt-get22:55:131
2528099450,9cyclictest23846-21missed_timers23:35:211
2528099450,8cyclictest25181-21apt-get23:40:101
2528099450,8cyclictest24013-21apt-get22:30:101
2528099450,8cyclictest1148-21apt-get22:50:141
2528099450,10cyclictest29014-21mailstats23:45:241
2528299447,6cyclictest41-21ksoftirqd/300:25:133
2528299442,5cyclictest41-21ksoftirqd/300:00:223
2528299441,6cyclictest401ktimersoftd/319:35:263
2528199447,5cyclictest33-21ksoftirqd/222:35:012
2528199445,2cyclictest33-21ksoftirqd/220:15:212
2528199444,9cyclictest33-21ksoftirqd/221:50:122
2528199441,6cyclictest33-21ksoftirqd/219:55:122
2528099440,9cyclictest11946-21apt-get22:05:121
2528099440,7cyclictest5807-21irqstats19:35:191
2528099440,10cyclictest21068-21iostat_ios23:30:181
139391440,0ptp4l401ktimersoftd/300:14:213
139391440,0ptp4l401ktimersoftd/300:14:203
25282994327,6cyclictest41-21ksoftirqd/323:40:123
2528299431,9cyclictest21703-21awk21:15:243
2528199438,5cyclictest33-21ksoftirqd/223:35:232
2528199437,6cyclictest33-21ksoftirqd/221:10:212
2528199437,4cyclictest33-21ksoftirqd/223:15:282
2528199437,4cyclictest33-21ksoftirqd/222:14:592
2528199433,9cyclictest33-21ksoftirqd/221:30:182
2528199430,5cyclictest33-21ksoftirqd/223:14:552
139391430,0ptp4l401ktimersoftd/323:15:143
139391430,0ptp4l401ktimersoftd/321:27:203
139391430,0ptp4l401ktimersoftd/321:27:203
2528199427,4cyclictest33-21ksoftirqd/221:00:212
2528199426,5cyclictest33-21ksoftirqd/221:45:102
2528199425,8cyclictest33-21ksoftirqd/219:50:172
2528199424,8cyclictest33-21ksoftirqd/221:35:132
2528199424,8cyclictest33-21ksoftirqd/220:20:222
2528199422,8cyclictest33-21ksoftirqd/223:25:212
2528199422,2cyclictest121rcu_preempt00:00:262
25281994217,4cyclictest33-21ksoftirqd/222:40:092
25281994217,4cyclictest33-21ksoftirqd/222:40:092
2528199420,5cyclictest321ktimersoftd/223:20:132
2528099420,9cyclictest11001-21ls00:15:221
2528099420,8cyclictest13174-21apt-get21:00:121
139391420,0ptp4l401ktimersoftd/322:10:363
139391420,0ptp4l401ktimersoftd/322:03:433
2528299411,5cyclictest0-21swapper/322:40:213
2528299411,5cyclictest0-21swapper/322:40:213
2528299410,12cyclictest3782-21wc20:40:133
2528199417,5cyclictest33-21ksoftirqd/220:40:182
2528199416,2cyclictest33-21ksoftirqd/221:05:152
2528199415,3cyclictest33-21ksoftirqd/200:10:132
2528199415,3cyclictest33-21ksoftirqd/200:10:132
2528099416,34cyclictest0-21swapper/122:02:141
2528099410,8cyclictest19892-21perl00:35:151
139391410,0ptp4l401ktimersoftd/323:50:533
139391410,0ptp4l401ktimersoftd/320:22:523
2528299401,5cyclictest0-21swapper/323:05:283
25282994014,6cyclictest41-21ksoftirqd/321:53:593
2528299400,6cyclictest41-21ksoftirqd/319:40:213
2528199404,8cyclictest33-21ksoftirqd/222:35:132
2528199404,5cyclictest33-21ksoftirqd/222:00:182
2528199403,7cyclictest33-21ksoftirqd/222:51:582
2528199400,6cyclictest33-21ksoftirqd/200:16:112
2528099400,15cyclictest17027-21apt-get00:30:111
2528299395,5cyclictest41-21ksoftirqd/320:55:123
2528199397,3cyclictest33-21ksoftirqd/222:25:132
2528199395,2cyclictest33-21ksoftirqd/222:45:122
2528199394,8cyclictest33-21ksoftirqd/220:45:172
2528199393,7cyclictest33-21ksoftirqd/220:11:502
2528199392,8cyclictest33-21ksoftirqd/220:50:182
2528099390,9cyclictest26288-21ps21:25:231
2528099390,9cyclictest26288-21ps21:25:231
2528099390,9cyclictest22892-21ps22:25:231
2528099390,8cyclictest22016-21users21:15:261
2528299386,7cyclictest13357-21sensors22:05:253
2528299381,8cyclictest41-21ksoftirqd/320:15:003
2528299381,7cyclictest41-21ksoftirqd/320:30:003
2528299380,7cyclictest41-21ksoftirqd/323:20:143
2528199383,3cyclictest33-21ksoftirqd/223:42:582
25280993832,4cyclictest25-21ksoftirqd/119:16:191
2528099380,9cyclictest7296-21ps20:45:231
2528099380,7cyclictest14754-21df_inode19:55:151
2528299377,3cyclictest41-21ksoftirqd/319:30:193
2528299372,6cyclictest41-21ksoftirqd/321:58:443
2528299371,7cyclictest41-21ksoftirqd/321:50:003
2528299370,4cyclictest716-21sshd22:47:553
2528199375,3cyclictest33-21ksoftirqd/220:30:122
2528199374,8cyclictest33-21ksoftirqd/221:15:372
2528199373,3cyclictest33-21ksoftirqd/219:27:592
2528299361,5cyclictest41-21ksoftirqd/322:58:273
2528199364,2cyclictest33-21ksoftirqd/219:40:182
25280993629,4cyclictest25-21ksoftirqd/121:10:121
25282993518,6cyclictest41-21ksoftirqd/321:30:223
2528199353,6cyclictest33-21ksoftirqd/219:45:152
2528099350,9cyclictest11003-21df23:10:131
25282993428,4cyclictest41-21ksoftirqd/320:31:383
2528299342,5cyclictest0-21swapper/323:25:253
2528299342,4cyclictest41-21ksoftirqd/321:14:213
25280993429,3cyclictest25-21ksoftirqd/120:17:221
25282993328,3cyclictest41-21ksoftirqd/323:33:203
2528299331,5cyclictest41-21ksoftirqd/323:10:223
25280993327,4cyclictest25-21ksoftirqd/123:16:161
25280993327,4cyclictest25-21ksoftirqd/100:00:001
25282993226,4cyclictest41-21ksoftirqd/323:59:593
25282993226,4cyclictest41-21ksoftirqd/320:37:523
25282993225,4cyclictest41-21ksoftirqd/300:30:353
2528299321,18cyclictest13766-21awk19:50:283
2528099320,11cyclictest15047-21diskstats00:25:151
25282993126,3cyclictest41-21ksoftirqd/322:24:553
25282993125,4cyclictest41-21ksoftirqd/321:36:453
25282993114,5cyclictest41-21ksoftirqd/321:20:253
25280993125,4cyclictest25-21ksoftirqd/122:15:541
2528099310,18cyclictest0-21swapper/119:50:131
2528099310,17cyclictest0-21swapper/119:10:131
25282993025,3cyclictest41-21ksoftirqd/321:40:423
25282993024,4cyclictest41-21ksoftirqd/322:26:073
25282993013,5cyclictest41-21ksoftirqd/300:20:143
2528299301,16cyclictest7386-21grep20:45:243
139391300,0ptp4l401ktimersoftd/319:24:383
2528099296,21cyclictest0-21swapper/121:51:501
25282992822,4cyclictest41-21ksoftirqd/319:47:023
2528099280,12cyclictest0-21swapper/100:06:031
2528299272,5cyclictest41-21ksoftirqd/320:16:323
25282992722,3cyclictest41-21ksoftirqd/323:45:103
25282992721,4cyclictest41-21ksoftirqd/300:05:203
25282992621,3cyclictest41-21ksoftirqd/322:32:103
25280992621,3cyclictest25-21ksoftirqd/119:46:161
139391250,0ptp4l401ktimersoftd/319:15:263
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional