You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-05 - 09:03
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot4.osadl.org (updated Fri Jun 05, 2026 00:45:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
125622205170,23sleep00-21swapper/019:08:370
138591202168,22phc2sys0-21swapper/319:07:033
126152201169,21sleep20-21swapper/219:09:202
125632197164,23sleep10-21swapper/119:08:391
1296299680,24cyclictest14605-21who22:25:283
1296299680,24cyclictest12532-21apt-config21:20:003
1296199686,18cyclictest12526-21cut21:20:012
1296299670,32cyclictest21169-21sed22:40:183
1296299670,24cyclictest4976-21sed23:15:013
1296299660,24cyclictest3629-21irqrtprio22:05:193
1296299660,23cyclictest13424-21df_abs19:10:143
1296299650,25cyclictest2082-21users20:55:263
1296199656,16cyclictest17440-21/usr/sbin/munin23:40:192
1296299640,26cyclictest17552-21awk21:30:003
1296299640,23cyclictest28652-21irqstats21:50:203
1296299640,22cyclictest5823-21hddtemp_smartct21:05:173
1296299640,22cyclictest5823-21hddtemp_smartct21:05:173
1296299631,22cyclictest23060-21cstates20:35:133
1296199636,18cyclictest7800-21grep21:10:132
1296199626,17cyclictest25782-21smartctl21:45:162
1296299610,23cyclictest22604-21cstates23:50:143
1296299590,30cyclictest26197-21irqstats21:45:203
1296199586,17cyclictest18802-21cat22:35:192
1296299570,23cyclictest1319-21snmpd20:34:553
1296199576,17cyclictest10047-21/usr/sbin/munin23:25:192
1296299550,24cyclictest18625-21grep19:20:163
1296299550,24cyclictest18625-21grep19:20:163
12960995524,4cyclictest25-21ksoftirqd/120:40:181
138491540,1ptp4l391rcuc/321:35:093
1296299541,49cyclictest23198-21grep22:45:173
1296299540,31cyclictest20593-21dpkg19:25:113
1296199549,18cyclictest31288-21needreboot21:55:222
1296199546,11cyclictest14204-21sed23:30:262
1296199537,11cyclictest17169-21taskset19:15:252
1296199527,10cyclictest9118-21sed20:05:212
12960995219,7cyclictest25-21ksoftirqd/122:49:591
1296199516,11cyclictest22945-21expr21:40:132
12960995124,4cyclictest25-21ksoftirqd/119:30:141
1296199505,17cyclictest15299-21/usr/sbin/munin21:25:172
1296199505,10cyclictest273302sleep200:00:082
1296199502,16cyclictest0-21swapper/222:10:182
12960995030,3cyclictest25-21ksoftirqd/123:00:001
12960995014,7cyclictest25-21ksoftirqd/123:40:001
1296199499,12cyclictest6307-21sed23:15:222
1296199496,12cyclictest12560-21cat22:25:012
1296199496,11cyclictest2620-21apt-key00:15:012
1296199496,11cyclictest16017-21cat20:20:162
1296299481,23cyclictest1319-21snmpd00:10:213
12960994820,3cyclictest25-21ksoftirqd/122:18:041
12960994816,4cyclictest25-21ksoftirqd/123:35:001
1296199477,11cyclictest20778-21sed23:45:192
1296199476,11cyclictest29976-21latency_hist21:55:002
1296199476,11cyclictest20334-21cpu20:30:132
1296199475,11cyclictest28235-21cstates19:40:132
1296199475,11cyclictest14502-21timerandwakeup20:15:242
1296199475,11cyclictest13990-21uname19:10:182
12960994719,7cyclictest25-21ksoftirqd/123:40:131
12960994718,7cyclictest25-21ksoftirqd/119:30:011
12960994640,3cyclictest27411-21sh21:50:011
12960994622,3cyclictest25-21ksoftirqd/100:15:171
12960994621,7cyclictest25-21ksoftirqd/123:00:221
12960994621,7cyclictest25-21ksoftirqd/123:00:221
1296199455,11cyclictest19382-21sed21:30:262
1296099458,4cyclictest25-21ksoftirqd/121:40:181
12960994512,4cyclictest25-21ksoftirqd/120:45:571
12960994512,3cyclictest25-21ksoftirqd/123:20:261
12960994510,3cyclictest25-21ksoftirqd/100:25:251
12962994436,5cyclictest2415-21cron23:10:003
1296199447,17cyclictest0-21swapper/200:35:252
1296199446,11cyclictest28579-21cut20:45:182
1296199446,11cyclictest27605-21/usr/sbin/munin22:55:242
1296099448,4cyclictest25-21ksoftirqd/120:50:271
1296099448,4cyclictest25-21ksoftirqd/119:10:271
1296099448,3cyclictest25-21ksoftirqd/119:55:131
1296099447,4cyclictest25-21ksoftirqd/119:35:261
12960994418,7cyclictest25-21ksoftirqd/120:30:231
12960994415,7cyclictest25-21ksoftirqd/122:00:011
12960994413,3cyclictest25-21ksoftirqd/119:55:001
12960994410,7cyclictest25-21ksoftirqd/121:55:001
1296199436,11cyclictest1025-21runrttasks23:05:182
1296099439,7cyclictest25-21ksoftirqd/100:10:191
1296099439,3cyclictest25-21ksoftirqd/123:05:191
1296099438,3cyclictest25-21ksoftirqd/123:10:121
1296099438,3cyclictest25-21ksoftirqd/119:15:251
1296099437,4cyclictest25-21ksoftirqd/122:10:191
1296099437,3cyclictest25-21ksoftirqd/122:05:241
12960994317,7cyclictest25-21ksoftirqd/122:25:221
12960994317,7cyclictest25-21ksoftirqd/122:00:231
12960994315,3cyclictest25-21ksoftirqd/100:33:211
12960994313,9cyclictest25-21ksoftirqd/100:00:121
12960994313,7cyclictest25-21ksoftirqd/100:05:161
12960994312,8cyclictest25-21ksoftirqd/121:00:181
12960994310,9cyclictest25-21ksoftirqd/123:55:001
12960994310,8cyclictest25-21ksoftirqd/121:20:001
12960994310,3cyclictest25-21ksoftirqd/123:25:151
1296099428,4cyclictest25-21ksoftirqd/120:00:111
1296099427,8cyclictest25-21ksoftirqd/123:15:241
1296099427,7cyclictest25-21ksoftirqd/122:35:151
1296099427,4cyclictest25-21ksoftirqd/121:20:241
1296099425,8cyclictest25-21ksoftirqd/119:20:181
1296099425,8cyclictest25-21ksoftirqd/119:20:181
12960994214,6cyclictest25-21ksoftirqd/119:45:211
12960994213,7cyclictest25-21ksoftirqd/122:40:121
12960994212,7cyclictest25-21ksoftirqd/120:15:131
12959994237,3cyclictest22518-21sh20:35:000
1296299410,26cyclictest31194-21ptp4l00:05:253
1296199416,12cyclictest31937-21savelog00:08:302
1296199415,11cyclictest14982-21seq23:35:112
1296099419,10cyclictest25-21ksoftirqd/100:20:201
1296099416,8cyclictest25-21ksoftirqd/122:30:131
1296099415,7cyclictest25-21ksoftirqd/120:20:121
1296099412,3cyclictest121rcu_preempt22:20:121
1296099411,6cyclictest25-21ksoftirqd/119:40:211
12960994115,3cyclictest25-21ksoftirqd/100:37:551
12960994113,7cyclictest25-21ksoftirqd/121:05:141
12960994113,7cyclictest25-21ksoftirqd/121:05:141
138491400,0ptp4l401ktimersoftd/322:10:273
1296299408,28cyclictest16123-21irqrtprio20:20:183
1296199407,11cyclictest25009-21sed22:50:002
1296199405,11cyclictest18122-21cat20:25:142
1296099408,7cyclictest25-21ksoftirqd/121:35:211
12960994014,6cyclictest25-21ksoftirqd/123:46:101
12960994013,6cyclictest25-21ksoftirqd/121:30:271
12960994013,6cyclictest25-21ksoftirqd/120:10:111
12960994013,4cyclictest25-21ksoftirqd/123:59:021
12960994012,6cyclictest25-21ksoftirqd/120:35:171
12960994010,8cyclictest25-21ksoftirqd/122:50:161
12959994032,5cyclictest9-21ksoftirqd/020:25:120
1296299394,33cyclictest32339-21latency_hist22:00:003
1296199396,11cyclictest3944-21sed21:00:202
1296199395,12cyclictest5957-21sh21:05:172
1296199395,12cyclictest5957-21sh21:05:172
12960993910,3cyclictest25-21ksoftirqd/121:25:041
1296099383,2cyclictest121rcu_preempt20:05:141
1296099381,2cyclictest121rcu_preempt21:10:221
12962993730,4cyclictest41-21ksoftirqd/320:19:543
1296299371,33cyclictest2852-21latency_hist19:54:593
1296199376,11cyclictest455-21avahi-daemon00:10:262
12961993731,3cyclictest33-21ksoftirqd/200:30:592
1296099372,3cyclictest121rcu_preempt20:55:101
12962993631,3cyclictest41-21ksoftirqd/323:45:113
12962993613,20cyclictest6615-21sed20:00:203
1296199364,8cyclictest0-21swapper/221:20:022
12961993629,4cyclictest33-21ksoftirqd/223:51:142
12961993629,4cyclictest33-21ksoftirqd/219:48:552
1296199362,16cyclictest0-21swapper/219:30:062
12959993629,4cyclictest9-21ksoftirqd/000:15:110
12962993530,3cyclictest41-21ksoftirqd/300:16:293
12962993529,4cyclictest41-21ksoftirqd/323:18:413
12962993528,4cyclictest41-21ksoftirqd/323:25:103
12962993528,4cyclictest41-21ksoftirqd/322:38:013
12962993528,4cyclictest41-21ksoftirqd/319:56:103
12962993513,19cyclictest17751-21/usr/sbin/munin21:30:153
1296199358,18cyclictest3332-21cat23:10:172
1296199356,12cyclictest1999-21sed22:00:292
12961993529,4cyclictest33-21ksoftirqd/220:39:102
12961993528,4cyclictest33-21ksoftirqd/220:03:082
12961993528,4cyclictest33-21ksoftirqd/200:26:122
12960993530,3cyclictest25-21ksoftirqd/120:25:131
12959993529,3cyclictest9-21ksoftirqd/000:25:140
12959993528,4cyclictest9-21ksoftirqd/023:54:000
12959993528,4cyclictest9-21ksoftirqd/019:45:280
1295999352,2cyclictest121rcu_preempt22:24:230
12962993429,3cyclictest41-21ksoftirqd/320:13:273
12962993428,4cyclictest41-21ksoftirqd/320:51:193
12962993428,4cyclictest41-21ksoftirqd/300:35:123
12962993427,5cyclictest41-21ksoftirqd/323:45:013
12962993415,16cyclictest41-21ksoftirqd/321:20:113
12962993413,18cyclictest7712-21/usr/sbin/munin00:25:123
12962993412,19cyclictest30077-21/usr/sbin/munin23:00:173
12962993412,19cyclictest30077-21/usr/sbin/munin23:00:173
1296299341,20cyclictest0-21swapper/300:30:143
12962993411,20cyclictest27332-21/usr/sbin/munin00:00:263
12962993411,20cyclictest15694-21expr19:15:133
1296199346,17cyclictest12075-21cat20:10:232
12961993428,4cyclictest33-21ksoftirqd/220:59:392
12961993428,4cyclictest33-21ksoftirqd/219:56:102
12961993428,3cyclictest33-21ksoftirqd/222:15:092
12959993428,4cyclictest9-21ksoftirqd/023:26:560
12959993428,4cyclictest9-21ksoftirqd/023:16:060
12959993428,4cyclictest9-21ksoftirqd/022:26:320
12959993428,4cyclictest9-21ksoftirqd/021:46:550
12959993428,4cyclictest9-21ksoftirqd/000:08:450
12959993427,4cyclictest9-21ksoftirqd/022:37:500
12959993427,4cyclictest9-21ksoftirqd/019:57:360
12959993427,4cyclictest9-21ksoftirqd/000:25:010
1296299333,27cyclictest223-21systemd-journal22:35:003
12962993327,3cyclictest41-21ksoftirqd/323:38:093
1296299331,29cyclictest10216-21latency_hist20:10:013
1296299331,28cyclictest31212-21grep19:45:173
1296299331,28cyclictest12502-21/usr/sbin/munin23:30:263
12962993311,19cyclictest29162-21wc19:40:213
12962993310,20cyclictest30157-21cat20:50:013
1296199336,11cyclictest31629-21cat23:00:252
1296199336,11cyclictest31629-21cat23:00:252
12961993328,3cyclictest33-21ksoftirqd/222:40:122
12961993328,3cyclictest33-21ksoftirqd/222:27:472
12961993327,3cyclictest33-21ksoftirqd/222:05:112
12959993328,3cyclictest9-21ksoftirqd/022:42:390
12959993328,3cyclictest9-21ksoftirqd/021:17:260
12959993328,3cyclictest9-21ksoftirqd/019:52:170
12959993327,4cyclictest9-21ksoftirqd/020:00:290
12959993326,4cyclictest9-21ksoftirqd/022:04:040
12959993326,4cyclictest9-21ksoftirqd/019:22:010
12959993326,4cyclictest9-21ksoftirqd/019:22:010
1296299329,20cyclictest4136-21processes21:00:233
1296299328,21cyclictest12521-21latency_hist22:25:003
1296299326,22cyclictest19152-21/usr/sbin/munin20:25:223
1296299321,26cyclictest7699-21apt-get21:10:113
1296299320,17cyclictest0-21swapper/323:20:273
1296199327,11cyclictest8882-21phc2sys23:20:222
1296199326,12cyclictest26614-21processes20:40:212
1296199325,11cyclictest25759-21cstates19:35:132
12961993227,3cyclictest33-21ksoftirqd/221:37:142
12961993226,4cyclictest33-21ksoftirqd/220:50:292
12959993227,3cyclictest9-21ksoftirqd/021:56:420
12959993226,4cyclictest9-21ksoftirqd/021:37:320
12959993226,3cyclictest9-21ksoftirqd/022:30:020
12959993226,3cyclictest9-21ksoftirqd/020:50:000
12959993225,4cyclictest9-21ksoftirqd/022:49:010
12962993126,3cyclictest41-21ksoftirqd/322:52:233
12962993125,4cyclictest41-21ksoftirqd/319:38:443
12962993112,17cyclictest27605-21/usr/sbin/munin22:55:273
1296199313,18cyclictest0-21swapper/222:50:202
12959993126,3cyclictest9-21ksoftirqd/023:10:240
12959993126,3cyclictest9-21ksoftirqd/019:19:160
12959993125,4cyclictest9-21ksoftirqd/023:58:300
12959993125,4cyclictest9-21ksoftirqd/021:51:240
12959993125,4cyclictest9-21ksoftirqd/020:20:460
12959993125,3cyclictest9934-21basename21:15:000
12959993125,3cyclictest9-21ksoftirqd/020:52:020
1295999310,2cyclictest121rcu_preempt23:36:240
1296299308,19cyclictest8413-21hddtemp_smartct22:15:153
1296299301,26cyclictest2315-21gnome-shell00:20:593
1296299301,24cyclictest22693-21apt-get21:40:123
1296199305,8cyclictest19461-21ps19:20:222
1296199305,8cyclictest19461-21ps19:20:222
12961993023,4cyclictest33-21ksoftirqd/219:52:162
1296199301,17cyclictest0-21swapper/200:20:122
12959993025,3cyclictest9-21ksoftirqd/021:25:460
12959993025,3cyclictest9-21ksoftirqd/021:20:120
12959993024,4cyclictest9-21ksoftirqd/023:32:180
12959993024,4cyclictest9-21ksoftirqd/000:01:020
12959993024,3cyclictest9-21ksoftirqd/023:23:030
12959993023,4cyclictest9-21ksoftirqd/023:04:060
12959993023,4cyclictest9-21ksoftirqd/023:04:060
1296299298,18cyclictest25315-21latency_hist19:35:003
12962992924,3cyclictest41-21ksoftirqd/320:43:533
1296299292,23cyclictest223-21systemd-journal23:55:343
12961992924,3cyclictest33-21ksoftirqd/219:25:102
12961992923,4cyclictest33-21ksoftirqd/223:56:032
12959992925,3cyclictest9-21ksoftirqd/021:07:060
12959992925,3cyclictest9-21ksoftirqd/021:07:060
12959992924,3cyclictest9-21ksoftirqd/019:33:050
12959992923,4cyclictest9-21ksoftirqd/021:43:060
12959992923,4cyclictest9-21ksoftirqd/021:04:310
12959992923,3cyclictest9-21ksoftirqd/023:40:100
12962992822,4cyclictest41-21ksoftirqd/322:02:193
12959992823,3cyclictest9-21ksoftirqd/022:52:330
12959992821,4cyclictest9-21ksoftirqd/020:15:040
12959992821,4cyclictest9-21ksoftirqd/000:35:130
12961992722,3cyclictest33-21ksoftirqd/222:33:302
12959992722,3cyclictest9-21ksoftirqd/022:55:170
12959992722,3cyclictest9-21ksoftirqd/021:33:230
12959992722,3cyclictest9-21ksoftirqd/019:43:520
12959992721,4cyclictest9-21ksoftirqd/020:10:470
12959992721,4cyclictest9-21ksoftirqd/019:27:260
12959992721,4cyclictest9-21ksoftirqd/000:32:000
12959992621,3cyclictest9-21ksoftirqd/022:14:550
12959992621,3cyclictest9-21ksoftirqd/019:37:100
12959992620,3cyclictest9-21ksoftirqd/022:05:030
12959992520,3cyclictest9-21ksoftirqd/020:58:340
12959992519,3cyclictest9-21ksoftirqd/023:06:360
12959992419,3cyclictest9-21ksoftirqd/022:19:450
12959992317,3cyclictest9-21ksoftirqd/000:10:070
12959992116,3cyclictest25018-21idleruntime-cro20:40:010
12959992015,3cyclictest8987-21irqstats20:05:200
12959992014,4cyclictest9-21ksoftirqd/019:12:420
12959992013,5cyclictest9-21ksoftirqd/023:47:430
12959991714,2cyclictest0-21swapper/020:43:410
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional