You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-31 - 09:29
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot7.osadl.org (updated Sun May 31, 2026 00:44:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
185329912160,55cyclictest18520-21cyclictest21:40:460
185329911553,10cyclictest31043-40logrotate23:50:080
18376210612,58sleep018400-21munin-run19:00:050
185329910484,12cyclictest25899-21diskmemload22:53:250
18532991033,52cyclictest12691-21apt-get22:25:240
18427210110,65sleep218446-21unin-run19:00:072
18532999770,10cyclictest181rcu_preempt23:20:050
18542999667,9cyclictest181rcu_preempt21:24:472
281852950,7sleep20-21swapper/222:50:302
18532999572,14cyclictest18520-21cyclictest00:06:240
18532999358,18cyclictest181rcu_preempt00:00:190
1853799923,79cyclictest22627-21apt-get19:10:181
1853799923,79cyclictest22627-21apt-get19:10:181
18532999171,14cyclictest20842-21apt-key20:45:080
18532999153,28cyclictest0-21swapper/021:05:060
18532998958,13cyclictest181rcu_preempt19:15:150
18532998954,15cyclictest181rcu_preempt22:15:280
18532998954,15cyclictest181rcu_preempt22:15:280
18537998862,20cyclictest27481-21sh21:55:311
1853799882,77cyclictest28355-21apt-get23:45:291
1853799873,77cyclictest7480-21kworker/u17:1+ext4-rsv-conversion22:25:301
18532998756,14cyclictest181rcu_preempt21:30:200
18542998632,16cyclictest0-21swapper/219:30:302
18532998651,16cyclictest181rcu_preempt21:24:180
18542998467,10cyclictest27131-21timerandwakeup21:00:412
18537998467,11cyclictest19773-21ssh00:25:041
18537998467,11cyclictest19773-21ssh00:25:041
18532998463,13cyclictest24891-21ssh22:45:260
18532998463,13cyclictest24891-21ssh22:45:260
18532998460,18cyclictest24047-21latency_hist20:55:070
18532998460,18cyclictest24047-21latency_hist20:55:070
18542998363,11cyclictest0-21swapper/200:15:262
18542998362,14cyclictest1-21systemd21:30:162
18537998357,19cyclictest26338-21kworker/u18:2+nfsiod23:29:351
18532998364,12cyclictest18520-21cyclictest23:35:590
18532998358,17cyclictest15934-21fschecks_count22:30:250
1854299824,59cyclictest13006-21ssh22:26:082
18537998261,15cyclictest20664-21apt-key21:45:071
18537998261,14cyclictest0-21swapper/122:25:071
18537998261,14cyclictest0-21swapper/122:25:071
18537998257,19cyclictest14598-21latency_hist21:35:071
18532998165,8cyclictest0-21swapper/023:10:320
18532998165,8cyclictest0-21swapper/023:10:320
18542998045,12cyclictest181rcu_preempt20:50:202
18542998045,12cyclictest181rcu_preempt20:50:202
18542998034,17cyclictest18520-21cyclictest21:19:002
1853299807,57cyclictest21059-21apt-get20:45:250
18532998059,10cyclictest0-21swapper/019:20:390
18532998052,10cyclictest181rcu_preempt23:25:160
18542997959,10cyclictest0-21swapper/223:35:552
18542997948,22cyclictest22972-21latency_hist00:30:072
18542997933,10cyclictest181rcu_preempt19:10:082
18532997960,10cyclictest0-21swapper/022:01:120
18532997956,17cyclictest21600-21sh21:46:290
18532997956,17cyclictest21600-21sh21:46:290
18532997955,12cyclictest0-21swapper/019:55:260
18532997937,7cyclictest181rcu_preempt00:10:190
18532997936,23cyclictest11630-21latency_hist21:30:070
1854299789,51cyclictest21352-21ssh21:46:202
1854299789,51cyclictest21352-21ssh21:46:202
18537997858,13cyclictest297-21systemd-logind21:55:051
18537997850,21cyclictest1374-21kworker/u18:1+nfsiod23:58:201
1853299783,45cyclictest27962-21dpkg23:45:060
1854299774,51cyclictest8150-21apt-get00:05:222
18532997759,8cyclictest0-21swapper/021:50:310
18532997749,11cyclictest181rcu_preempt19:25:200
18542997629,21cyclictest20885-21apt-key20:45:082
18537997655,14cyclictest28161-21kworker/u17:0-writeback22:55:261
18537997654,15cyclictest25899-21diskmemload23:20:391
18537997650,19cyclictest21883-21latency_hist23:35:061
1853799763,42cyclictest20420-21apt-get21:45:191
1853799763,42cyclictest20420-21apt-get21:45:191
18532997658,12cyclictest1-21systemd23:23:170
18532997643,23cyclictest30558-21latency_hist19:35:070
18532997640,8cyclictest0-21swapper/022:40:220
18542997556,9cyclictest0-21swapper/223:30:292
18542997525,11cyclictest181rcu_preempt23:10:222
18542997525,11cyclictest181rcu_preempt23:10:222
18537997558,12cyclictest18520-21cyclictest22:05:411
18537997557,10cyclictest29416-21diskmemload22:52:271
18537997552,18cyclictest12381-21kworker/u17:1+events_unbound20:50:041
18537997544,22cyclictest5526-21grep21:20:061
1853299756,55cyclictest18694-21/usr/sbin/munin19:00:320
18532997543,12cyclictest181rcu_preempt19:45:290
18532997537,12cyclictest181rcu_preempt23:57:120
18532997534,33cyclictest14380-21cpu20:25:210
18542997456,8cyclictest0-21swapper/223:20:072
18542997450,18cyclictest11434-21cut21:30:062
18542997450,12cyclictest31043-40logrotate23:50:062
1854299742,39cyclictest32467-21fschecks_count19:40:262
18537997455,14cyclictest18520-21cyclictest00:19:161
18537997454,14cyclictest26004-21timerandwakeup23:40:401
18537997448,19cyclictest6466-21sh22:15:151
18537997448,19cyclictest6466-21sh22:15:151
18537997437,12cyclictest181rcu_preempt19:45:261
1853799743,56cyclictest8150-21apt-get00:05:591
1853799743,51cyclictest24547-21apt-get20:55:231
1853799743,51cyclictest24547-21apt-get20:55:231
18532997460,8cyclictest0-21swapper/000:20:200
18532997460,8cyclictest0-21swapper/000:20:200
18532997454,11cyclictest0-21swapper/022:35:190
18532997454,11cyclictest0-21swapper/022:35:190
18532997453,12cyclictest0-21swapper/020:35:260
18542997353,10cyclictest0-21swapper/222:30:192
18542997333,7cyclictest181rcu_preempt20:10:192
18542997333,7cyclictest181rcu_preempt20:10:192
1854299733,24cyclictest7149-21grep20:00:402
1854299733,24cyclictest7149-21grep20:00:402
18542997323,13cyclictest181rcu_preempt23:25:272
18537997356,11cyclictest1-21systemd19:31:531
18537997350,16cyclictest277-21dbus-daemon23:00:371
18537997350,16cyclictest277-21dbus-daemon23:00:371
18532997354,7cyclictest181rcu_preempt20:30:200
1841127312,38sleep118406-21munin-run19:00:061
18542997244,13cyclictest24653-21/usr/sbin/munin22:45:242
18542997244,13cyclictest24653-21/usr/sbin/munin22:45:242
18542997227,8cyclictest181rcu_preempt21:05:292
1854299722,39cyclictest1608-21modprobe23:55:032
18537997254,9cyclictest0-21swapper/122:35:391
18537997254,9cyclictest0-21swapper/122:35:391
1853799725,45cyclictest31045-21kernelversion19:35:291
18537997254,10cyclictest0-21swapper/121:10:271
18537997251,15cyclictest25899-21diskmemload21:05:181
18537997244,19cyclictest22674-21kernelversion23:35:481
18532997250,12cyclictest0-21swapper/021:00:070
18532997250,12cyclictest0-21swapper/021:00:070
18532997247,18cyclictest1255-21latency_hist19:45:070
18532997243,21cyclictest3451-21processes21:15:380
18532997242,9cyclictest181rcu_preempt23:53:290
18532997237,11cyclictest181rcu_preempt20:20:060
18532997237,11cyclictest181rcu_preempt20:20:060
1853299722,35cyclictest1940-21tr23:00:370
1853299722,35cyclictest1940-21tr23:00:370
18542997155,11cyclictest30658-21/usr/sbin/munin22:55:252
18542997143,8cyclictest31071-21ssh22:00:452
18542997131,8cyclictest181rcu_preempt20:45:512
18542997129,12cyclictest181rcu_preempt19:40:072
18542997115,9cyclictest0-21swapper/223:00:182
18542997115,9cyclictest0-21swapper/223:00:182
18537997146,18cyclictest11085-21ntpd19:25:321
1853799714,45cyclictest4105-21ssh22:10:341
18537997119,13cyclictest301ktimers/122:40:351
18537997114,18cyclictest8637-21cut21:25:081
18532997155,9cyclictest0-21swapper/019:11:230
18532997155,9cyclictest0-21swapper/019:11:230
18532997147,10cyclictest181rcu_preempt20:06:060
18532997144,10cyclictest181rcu_preempt21:06:280
18532997140,10cyclictest181rcu_preempt21:56:570
1853299713,59cyclictest4116-21ntp_states22:10:340
18542997053,8cyclictest0-21swapper/222:35:282
18542997053,8cyclictest0-21swapper/222:35:282
18542997052,8cyclictest0-21swapper/222:05:382
18542997051,9cyclictest0-21swapper/222:25:082
18542997048,16cyclictest18520-21cyclictest20:09:292
18542997047,13cyclictest0-21swapper/200:10:192
18542997037,25cyclictest2214-21sh21:14:282
18542997024,12cyclictest181rcu_preempt22:10:282
1853799706,54cyclictest14780-21ssh21:35:211
1853799705,49cyclictest4925-21cpu00:00:201
1853799704,45cyclictest31339-21/usr/sbin/munin23:50:361
1853799703,36cyclictest12971-21fschecks_count20:20:241
18537997021,11cyclictest301ktimers/119:20:371
18537997014,26cyclictest0-21swapper/122:45:251
18537997014,26cyclictest0-21swapper/122:45:251
18532997039,10cyclictest181rcu_preempt19:35:170
18532997025,11cyclictest181rcu_preempt20:00:320
18532997025,11cyclictest181rcu_preempt20:00:320
1853299702,31cyclictest2619-21latency_hist21:15:070
18542996952,10cyclictest18520-21cyclictest19:25:252
18542996934,11cyclictest16223-21fschecks_time20:30:262
18542996930,11cyclictest181rcu_preempt00:25:072
18542996930,11cyclictest181rcu_preempt00:25:072
18542996917,22cyclictest18122-21awk20:35:342
1853799695,37cyclictest11392-21fschecks_count00:10:241
18537996950,13cyclictest10854-21open_inodes23:15:371
18537996942,14cyclictest0-21swapper/120:40:251
1853799693,43cyclictest10035-21latency_hist23:15:071
1853799693,43cyclictest10035-21latency_hist23:15:071
18537996922,9cyclictest301ktimers/100:30:071
18537996922,10cyclictest301ktimers/123:05:151
18532996941,9cyclictest181rcu_preempt19:05:320
18532996940,23cyclictest0-21swapper/022:10:040
1854299684,38cyclictest300-21rs:main2
1853799684,41cyclictest352-21runrttasks20:52:081
1853799684,41cyclictest352-21runrttasks20:52:081
1853799682,47cyclictest16248-21fschecks_time20:30:261
1853799682,42cyclictest32479-21fschecks_count19:40:261
18532996851,11cyclictest0-21swapper/022:55:400
18532996825,14cyclictest15078-21timerwakeupswit00:15:410
18542996747,12cyclictest58-21kcompactd019:45:322
18542996747,12cyclictest0-21swapper/200:02:552
1854299673,41cyclictest4676-21latency_hist00:00:062
1854299673,23cyclictest9475-21apt-get22:20:162
1853799674,53cyclictest26238-21ssh21:00:171
1853799674,47cyclictest5599-21grep19:55:411
1853799674,42cyclictest11918-21timerandwakeup20:15:401
1853799674,42cyclictest11918-21timerandwakeup20:15:401
18537996721,8cyclictest301ktimers/119:00:411
18532996746,15cyclictest4506-21latency_hist19:55:060
18532996745,7cyclictest181rcu_preempt20:25:060
1853299673,30cyclictest7082-21latency_hist23:10:070
18542996647,13cyclictest26633-21cron21:55:042
18542996639,10cyclictest13414-21grep23:20:242
18542996628,9cyclictest181rcu_preempt19:11:402
18542996628,9cyclictest181rcu_preempt19:11:402
18542996620,19cyclictest14994-21fschecks_count21:35:272
18542996614,18cyclictest25662-21latency_hist19:20:062
1853799664,31cyclictest22099-21apt-get19:10:051
18537996638,9cyclictest181rcu_preempt19:51:311
18537996621,8cyclictest301ktimers/119:17:451
18532996651,10cyclictest19683-21ssh23:30:300
18532996631,23cyclictest181rcu_preempt00:29:490
1854999659,47cyclictest24571-21chrt20:55:303
1854999659,47cyclictest24571-21chrt20:55:303
1854999653,53cyclictest28414-21chrt23:45:263
18542996547,12cyclictest26538-21switchtime19:20:392
1854299652,45cyclictest12068-21unixbench_multi20:15:412
1854299652,45cyclictest12068-21unixbench_multi20:15:412
1853799656,15cyclictest31-21ksoftirqd/122:00:341
18537996546,12cyclictest18520-21cyclictest22:31:001
1853799654,33cyclictest7719-21latency_hist20:05:071
1853799654,33cyclictest7719-21latency_hist20:05:071
1853799654,32cyclictest352-21runrttasks20:07:471
1853799652,46cyclictest10368-21grep20:10:391
1853799652,46cyclictest10368-21grep20:10:391
18532996548,13cyclictest18520-21cyclictest22:20:400
18532996548,13cyclictest18520-21cyclictest22:20:400
18532996544,8cyclictest181rcu_preempt21:35:180
1853299653,40cyclictest9523-21/usr/sbin/munin20:10:320
1853299653,40cyclictest9523-21/usr/sbin/munin20:10:320
18549996442,16cyclictest451rcuc/322:09:353
18542996448,11cyclictest29492-21sh21:59:432
18542996436,19cyclictest25899-21diskmemload22:45:062
18542996436,19cyclictest0-21swapper/222:15:202
18542996436,19cyclictest0-21swapper/222:15:202
18542996435,20cyclictest13338-21processes20:20:352
1854299643,44cyclictest15327-21grep20:25:422
1854299642,28cyclictest20425-21munin-run21:45:042
18537996438,12cyclictest0-21swapper/120:30:071
1853799643,20cyclictest17605-21apt-get20:35:171
18542996330,9cyclictest18913-21fschecks_count19:00:252
1854299632,29cyclictest6063-21systemd-run20:00:062
18549996244,13cyclictest451rcuc/320:45:103
1854999623,42cyclictest6257-21chrt21:20:303
1854299625,13cyclictest3273-21fschecks_count19:50:252
1854299622,39cyclictest5065-21threads23:05:402
1853799624,43cyclictest9017-21fschecks_time21:25:261
18549996141,14cyclictest451rcuc/320:15:293
18549996141,14cyclictest451rcuc/320:15:293
18549996141,13cyclictest451rcuc/321:26:223
18542996147,9cyclictest58-21kcompactd020:57:232
18542996147,9cyclictest58-21kcompactd020:57:232
18549995939,13cyclictest451rcuc/321:54:553
1854999583,42cyclictest2792-21taskset19:50:053
1723225822,21sleep30-21swapper/318:55:313
1854999573,37cyclictest17019-21chrt00:20:073
1854999554,37cyclictest13619-21chrt20:20:383
1854999553,37cyclictest18919-21taskset21:40:523
18549995435,12cyclictest451rcuc/320:01:073
18549995435,12cyclictest451rcuc/320:01:073
1854999543,37cyclictest5197-21chrt22:12:223
1854999543,36cyclictest24817-21chrt23:40:033
18549995433,15cyclictest451rcuc/323:26:183
1854999534,29cyclictest0-21swapper/319:10:183
1854999534,29cyclictest0-21swapper/319:10:183
18549995339,9cyclictest451rcuc/323:53:383
18549995339,9cyclictest451rcuc/319:24:303
1854999533,39cyclictest1110-21taskset23:00:073
1854999533,36cyclictest30662-21taskset22:00:383
1854999533,36cyclictest23510-21taskset20:50:403
1854999533,36cyclictest23510-21taskset20:50:403
18549995329,17cyclictest451rcuc/300:28:023
1854999525,31cyclictest0-21swapper/322:25:283
1854999524,36cyclictest15836-21taskset22:30:213
1854999524,34cyclictest315-21chrt21:10:333
1854999524,31cyclictest0-21swapper/300:05:593
1854999523,38cyclictest8648-21chrt20:06:173
1854999523,36cyclictest29232-21taskset21:05:183
1854999523,35cyclictest756-21taskset19:40:413
1854999523,35cyclictest28551-21chrt21:04:083
1854999514,33cyclictest14662-21taskset20:25:283
1854999513,37cyclictest29946-21chrt22:53:563
1854999513,36cyclictest7819-21chrt23:10:333
1854999513,36cyclictest7819-21chrt23:10:333
1854999513,35cyclictest3242-21chrt21:15:313
1854999513,35cyclictest25062-21chrt23:40:073
1854999513,34cyclictest9848-21chrt22:20:283
1854999513,34cyclictest9848-21chrt22:20:283
1854999513,32cyclictest14756-21chrt21:35:163
1854999513,31cyclictest21024-21taskset20:45:093
1854999512,36cyclictest2245-21chrt23:00:403
1854999512,36cyclictest2245-21chrt23:00:403
1854999506,20cyclictest0-21swapper/321:45:373
1854999506,20cyclictest0-21swapper/321:45:373
18549995037,9cyclictest451rcuc/320:30:193
18549995036,9cyclictest451rcuc/321:33:113
1854999503,37cyclictest25719-21chrt22:45:413
1854999503,37cyclictest25719-21chrt22:45:413
1854999503,36cyclictest27637-21chrt21:55:353
1854999503,36cyclictest2761-21chrt23:55:403
1854999503,34cyclictest6059-21chrt20:00:053
1854999503,34cyclictest19517-21chrt23:30:273
1854999503,34cyclictest12925-21chrt23:20:053
1854999503,32cyclictest7962-21chrt00:05:083
1854999502,39cyclictest13203-21chrt23:20:183
1854999502,36cyclictest4362-21chrt23:05:223
1854999502,35cyclictest19201-21taskset19:00:313
1854999502,32cyclictest4557-21chrt19:55:073
1854999492,35cyclictest20867-21chrt22:38:403
1854999492,35cyclictest20867-21chrt22:38:403
1854999483,32cyclictest12594-21chrt00:11:363
1854999483,31cyclictest25789-21chrt19:20:083
1854999473,34cyclictest17167-21chrt00:20:193
1854999473,34cyclictest17167-21chrt00:20:193
1854999473,31cyclictest6662-21chrt22:15:223
1854999473,31cyclictest6662-21chrt22:15:223
1854999472,35cyclictest23624-21chrt22:43:013
1854999472,32cyclictest22303-21chrt19:10:073
18549994633,9cyclictest451rcuc/319:34:063
1854999433,31cyclictest10253-21taskset20:10:383
1854999433,31cyclictest10253-21taskset20:10:383
18549994128,9cyclictest451rcuc/319:37:263
1854999393,27cyclictest27729-21taskset19:25:263
1854999392,27cyclictest17613-21taskset20:35:203
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional