You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-15 - 20:09
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot7.osadl.org (updated Sun Mar 15, 2026 12:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
15739912264,53cyclictest1564-21cyclictest11:55:460
15739912169,46cyclictest8926-21diskmemload10:50:360
308212012,76sleep2314-21/usr/sbin/munin07:01:292
15739911848,65cyclictest0-21swapper/012:30:480
15739911848,65cyclictest0-21swapper/012:30:480
15739911757,54cyclictest6980-21munin-run10:50:110
15739911757,54cyclictest6980-21munin-run10:50:110
1573991152,27cyclictest22124-21taskset11:15:120
1573991083,90cyclictest16705-21apt-get07:50:230
1573991083,34cyclictest1575-21cat07:05:150
15739910740,61cyclictest0-21swapper/009:45:390
15739910663,35cyclictest11557-21ntp_kernel_pll_11:50:400
15739910663,35cyclictest11557-21ntp_kernel_pll_11:50:400
1573991043,27cyclictest9724-21runrttasks11:47:320
15739910243,48cyclictest0-21swapper/008:00:480
15739910243,48cyclictest0-21swapper/008:00:480
1573991022,22cyclictest23890-21taskset10:23:410
15739910145,50cyclictest0-21swapper/010:10:440
15739910143,49cyclictest0-21swapper/008:50:370
1573991013,25cyclictest21037-21sh10:19:030
15819910055,39cyclictest544-21cron10:50:111
15819910055,39cyclictest544-21cron10:50:111
1573991002,24cyclictest23209-21ssh12:10:410
157399993,25cyclictest1742-21/usr/sbin/munin07:05:380
157399993,25cyclictest1742-21/usr/sbin/munin07:05:380
157399992,28cyclictest352-21runrttasks09:02:570
1581999857,34cyclictest14974-21systemd-run09:15:121
1573999849,42cyclictest0-21swapper/008:45:480
1573999849,42cyclictest0-21swapper/008:45:480
157399982,26cyclictest15398-21expr09:15:280
158899973,73cyclictest20525-21kworker/u18:2+flush-179:012:10:272
1573999742,49cyclictest0-21swapper/012:20:420
157399972,32cyclictest31267-21seq11:30:130
157399972,23cyclictest31152-21if_eth010:35:360
157399972,23cyclictest31152-21if_eth010:35:360
1581999652,37cyclictest0-21swapper/112:25:501
1573999640,50cyclictest0-21swapper/011:42:440
1573999640,50cyclictest0-21swapper/011:42:440
1573999639,50cyclictest16525-21apt-get11:06:090
1588999574,15cyclictest297-21systemd-logind12:30:122
1581999554,36cyclictest20787-21kworker/u17:3+events_unbound09:35:111
1573999546,42cyclictest0-21swapper/008:10:490
1573999542,47cyclictest1-21systemd07:45:450
1573999539,51cyclictest0-21swapper/012:25:300
157399953,80cyclictest12432-21/usr/sbin/munin09:10:330
157399953,33cyclictest352-21runrttasks09:21:330
157399952,28cyclictest352-21runrttasks10:09:440
157399952,28cyclictest11247-21timerwakeupswit10:55:460
157399943,26cyclictest22925-21runrttasks12:10:150
157399943,10cyclictest7045-21apt-get07:20:220
1573999342,45cyclictest0-21swapper/010:40:280
157399933,82cyclictest15973-21sh11:05:110
157399933,82cyclictest15973-21sh11:05:110
1573999335,49cyclictest0-21swapper/011:25:150
1573999335,49cyclictest0-21swapper/011:25:150
1573999312,28cyclictest19129-21rm12:03:540
1573999312,28cyclictest19129-21rm12:03:540
1581999268,18cyclictest3536-21sh09:50:141
157399924,26cyclictest27730-21/usr/sbin/munin10:30:470
1573999238,46cyclictest0-21swapper/009:05:270
1573999238,46cyclictest0-21swapper/009:05:270
157399923,31cyclictest3950-21/usr/sbin/munin07:10:340
157399922,82cyclictest352-21runrttasks09:33:150
157399922,34cyclictest27268-21ssh09:35:240
158899918,60cyclictest16584-21runrttasks11:05:342
1573999139,44cyclictest29560-21cron08:30:150
157399913,30cyclictest10094-21fschecks_time10:00:330
157399913,29cyclictest1749-21systemctl11:35:110
1573999131,50cyclictest0-21swapper/008:00:140
1573999131,50cyclictest0-21swapper/008:00:140
157399912,30cyclictest24775-21ssh10:25:260
157399912,23cyclictest9466-21idleruntime-cro10:00:110
1581999076,8cyclictest0-21swapper/111:15:431
157399903,28cyclictest2540-21cat11:35:380
157399903,20cyclictest27658-21taskset08:24:070
1573999024,59cyclictest0-21swapper/007:25:270
1581998970,9cyclictest0-21swapper/111:35:291
1581998960,17cyclictest31037-21sh10:35:341
1581998960,17cyclictest31037-21sh10:35:341
1581998942,40cyclictest8926-21diskmemload11:26:101
157399894,29cyclictest22713-21ssh11:15:320
157399893,30cyclictest26158-21awk08:20:120
157399893,29cyclictest30221-21/usr/sbin/munin09:40:270
157399893,27cyclictest12060-21fschecks_count07:35:320
157399892,28cyclictest3802-21seq09:50:260
157399892,23cyclictest26109-21sh12:15:250
1573998866,15cyclictest1564-21cyclictest07:15:320
157399883,30cyclictest10785-21taskset07:30:410
157399883,30cyclictest10785-21taskset07:30:410
157399883,26cyclictest6139-21ls08:55:360
157399883,25cyclictest1460-21ntpq08:41:350
157399883,25cyclictest1460-21ntpq08:41:350
157399882,27cyclictest21426-21df_inode09:25:300
1588998758,20cyclictest28786-21ssh12:20:132
157399873,28cyclictest28237-21/usr/sbin/munin08:25:210
157399873,27cyclictest13476-21/usr/sbin/munin07:40:390
157399873,24cyclictest21810-21tune2fs08:05:340
157399873,24cyclictest21810-21tune2fs08:05:340
1581998669,8cyclictest0-21swapper/109:00:151
1581998628,48cyclictest0-21swapper/109:15:211
157399863,25cyclictest31640-21/usr/sbin/munin08:35:320
158199854,39cyclictest31456-21/usr/sbin/munin08:35:481
158199843,30cyclictest21508-21grep09:25:331
158199843,27cyclictest24526-21idleruntime-cro08:15:111
1581998427,49cyclictest0-21swapper/111:40:201
1581998427,49cyclictest0-21swapper/111:40:201
158199842,33cyclictest20482-21unixbench_singl11:10:491
1581998416,32cyclictest13880-21cat11:55:151
1581998416,32cyclictest13880-21cat11:55:151
158199833,30cyclictest23039-21modprobe12:10:161
158199833,29cyclictest27967-21cmp08:25:141
158199832,30cyclictest19220-21latency_hist11:10:141
3257728212,46sleep132550-21apt-get07:00:431
158899823,38cyclictest13628-21ssh11:55:112
158899823,38cyclictest13628-21ssh11:55:112
1581998263,8cyclictest0-21swapper/108:35:141
1581998262,14cyclictest18449-21latency_hist10:15:151
1581998262,13cyclictest0-21swapper/110:30:351
158199824,30cyclictest16903-21fschecks_count07:50:341
158199824,27cyclictest5403-21latency_hist12:35:141
158199824,27cyclictest5403-21latency_hist12:35:141
1581998241,35cyclictest0-21swapper/112:00:141
158199823,36cyclictest8745-21mailstats11:45:441
158199823,29cyclictest20859-21unixbench_multi08:00:481
158199823,29cyclictest20859-21unixbench_multi08:00:481
158199822,40cyclictest19940-21ssh09:22:271
1581998220,55cyclictest3092-21modprobe07:10:121
1581998220,55cyclictest3092-21modprobe07:10:121
1581998215,28cyclictest277-21dbus-daemon07:25:131
1581998166,8cyclictest0-21swapper/110:50:471
1581998160,10cyclictest0-21swapper/112:20:301
158199814,37cyclictest19882-21/usr/sbin/munin12:05:211
158199814,29cyclictest29923-21latency_hist09:40:161
158199814,25cyclictest17179-21fschecks_count12:00:321
158199814,25cyclictest17179-21fschecks_count12:00:321
158199813,38cyclictest7773-21fschecks_count09:00:471
158199813,38cyclictest10328-21ssh10:55:251
158199813,37cyclictest352-21runrttasks10:28:051
158199813,32cyclictest19721-21wc10:15:481
158199813,30cyclictest6961-21runrttasks09:55:291
158199813,24cyclictest19237-21unixbench_multi07:55:481
158199813,24cyclictest19237-21unixbench_multi07:55:481
1581998115,25cyclictest27183-21sh12:15:491
1581998114,29cyclictest24024-21seq10:24:031
158199804,36cyclictest2460-21/usr/sbin/munin08:45:441
158199804,36cyclictest2460-21/usr/sbin/munin08:45:441
158199804,26cyclictest2005-21latency_hist11:35:151
158199803,43cyclictest28255-21apt-get08:25:251
158199803,30cyclictest5580-21latency_hist08:55:141
158199803,29cyclictest13711-21tune2fs07:40:331
158199803,28cyclictest16005-21gpgv11:05:131
158199803,28cyclictest16005-21gpgv11:05:131
158199803,25cyclictest27305-21runrttasks11:23:101
158199803,25cyclictest27305-21runrttasks11:23:101
158199803,23cyclictest840-21/usr/sbin/munin08:41:231
158199803,23cyclictest840-21/usr/sbin/munin08:41:231
158199802,27cyclictest30718-21cat09:40:371
158199795,32cyclictest9637-21vmstat07:25:501
158199794,36cyclictest6776-21latency_hist07:20:151
158199794,25cyclictest12971-21/usr/sbin/munin10:05:321
158199793,31cyclictest10022-21fschecks_count10:00:321
158199793,28cyclictest352-21runrttasks08:09:251
158199793,28cyclictest352-21runrttasks08:09:251
158199793,25cyclictest4081-21/usr/sbin/munin07:10:381
1581997932,39cyclictest0-21swapper/109:05:301
1581997932,39cyclictest0-21swapper/109:05:301
158199792,26cyclictest16020-21grep07:45:471
1588997856,13cyclictest0-21swapper/209:10:112
1588997856,13cyclictest0-21swapper/209:10:112
1588997849,10cyclictest181rcu_preempt11:25:272
158199784,34cyclictest352-21runrttasks07:31:541
158199784,34cyclictest352-21runrttasks07:31:541
158199783,25cyclictest1476-21seq10:40:291
1588997759,13cyclictest352-21runrttasks10:18:242
158199773,29cyclictest13241-21idleruntime-cro07:40:111
1581997731,41cyclictest0-21swapper/109:50:381
1588997658,12cyclictest297-21systemd-logind08:20:132
1588997649,17cyclictest0-21swapper/209:00:162
158199763,24cyclictest24983-21fschecks_count08:15:321
1588997557,12cyclictest297-21systemd-logind09:40:132
1588997552,15cyclictest298-21in:imuxsock08:40:142
158899753,34cyclictest352-21runrttasks10:30:472
159499743,58cyclictest7726-21taskset11:45:123
159499743,58cyclictest7726-21taskset11:45:123
1588997456,12cyclictest1-21systemd11:25:132
1588997456,12cyclictest1-21systemd11:25:132
1588997453,15cyclictest17631-21sh10:12:582
1588997452,16cyclictest8926-21diskmemload11:55:342
1588997353,14cyclictest1752-21latency_hist11:35:152
1588997348,17cyclictest16275-21latency_hist11:05:152
1588997348,17cyclictest16275-21latency_hist11:05:152
1588997344,20cyclictest23335-21timerwakeupswit11:15:462
158899732,21cyclictest3090-21modprobe07:10:122
158899732,21cyclictest3090-21modprobe07:10:122
159499723,55cyclictest6832-21taskset10:49:493
159499723,55cyclictest6832-21taskset10:49:493
159499723,53cyclictest28642-21taskset11:25:333
1588997254,12cyclictest13484-21sshd10:05:442
1588997249,17cyclictest374-21sshd09:50:442
158899723,41cyclictest4731-21cron11:40:112
1588997211,25cyclictest0-21swapper/208:10:482
159499714,51cyclictest9110-21taskset11:45:493
1588997146,16cyclictest0-21swapper/209:15:442
1588997145,18cyclictest1564-21cyclictest10:25:372
158899712,43cyclictest1624-21fschecks_time10:40:332
159499703,55cyclictest3984-21chrt10:45:113
158899703,50cyclictest21766-21fschecks_count08:05:342
158899703,50cyclictest21766-21fschecks_count08:05:342
158899703,50cyclictest11363-21head10:55:482
159499693,52cyclictest4635-21chrt08:50:433
159499693,52cyclictest20799-21taskset10:18:233
159499693,52cyclictest11894-21taskset10:03:393
159499693,51cyclictest20339-21taskset08:00:373
159499693,51cyclictest20339-21taskset08:00:373
159499692,53cyclictest23871-21taskset10:23:383
159499692,53cyclictest17194-21taskset11:07:043
1588996952,12cyclictest298-21in:imuxsock11:15:122
159499683,54cyclictest18857-21taskset12:03:083
159499683,54cyclictest18857-21taskset12:03:083
159499683,52cyclictest8395-21chrt10:50:503
159499683,52cyclictest3985-21chrt09:50:343
159499683,52cyclictest13602-21taskset11:55:093
159499683,52cyclictest13602-21taskset11:55:093
159499682,52cyclictest15607-21taskset11:04:123
159499682,52cyclictest15607-21taskset11:04:123
159499682,50cyclictest8300-21taskset07:24:203
1588996846,13cyclictest0-21swapper/207:35:322
158899683,46cyclictest8926-21diskmemload10:35:222
158899683,46cyclictest8926-21diskmemload10:35:222
159499673,52cyclictest17223-21chrt07:50:413
159499673,51cyclictest24213-21taskset08:11:343
159499673,50cyclictest28175-21taskset12:18:363
159499673,50cyclictest26030-21taskset10:26:173
159499672,53cyclictest24129-21chrt11:17:343
159499672,52cyclictest2881-21taskset11:35:473
159499672,52cyclictest21569-21chrt08:05:273
159499672,52cyclictest21569-21chrt08:05:273
159499672,52cyclictest15453-21taskset09:15:313
159499672,50cyclictest21046-21taskset12:05:553
159499672,35cyclictest28135-21chrt10:30:353
158899677,40cyclictest858-21apt-get08:40:272
158899677,40cyclictest858-21apt-get08:40:272
1588996746,15cyclictest544-21cron07:15:122
158899673,45cyclictest17323-21sendmail_mailqu07:50:452
159499663,51cyclictest26951-21chrt08:20:423
159499663,51cyclictest15909-21taskset07:45:473
159499663,51cyclictest14750-21chrt10:08:173
159499663,50cyclictest26628-21taskset11:21:153
159499663,50cyclictest26628-21taskset11:21:153
159499663,50cyclictest18204-21chrt09:20:173
159499663,50cyclictest15125-21chrt11:55:583
159499663,49cyclictest750-21chrt12:26:023
159499663,34cyclictest32621-21chrt08:37:513
159499662,51cyclictest31590-21chrt12:24:523
159499662,50cyclictest11449-21taskset09:08:543
159499662,50cyclictest11449-21taskset09:08:543
158899667,26cyclictest8926-21diskmemload10:48:472
158899667,26cyclictest8926-21diskmemload10:48:472
1588996650,9cyclictest8792-21sensors_temp11:45:442
1588996647,13cyclictest544-21cron11:45:112
1588996647,13cyclictest544-21cron11:45:112
158899663,42cyclictest27122-21latency_hist09:35:152
158899663,40cyclictest19499-21sh09:21:132
158899662,39cyclictest21755-21/usr/sbin/munin10:20:342
1588996619,11cyclictest6981-21diskstats09:55:312
1588996618,17cyclictest30624-21if_eth009:40:352
159499652,50cyclictest8817-21taskset09:58:243
159499652,50cyclictest30990-21chrt08:32:533
159499652,50cyclictest1724-21chrt11:35:103
159499652,33cyclictest32410-21chrt09:43:493
159499652,33cyclictest29650-21chrt09:39:273
1588996542,13cyclictest0-21swapper/209:25:382
1588996540,17cyclictest0-21swapper/207:20:142
1588996540,15cyclictest0-21swapper/212:05:112
1588996540,15cyclictest0-21swapper/212:05:112
1588996510,22cyclictest11043-21timerandwakeup07:30:472
1588996510,22cyclictest11043-21timerandwakeup07:30:472
159499643,48cyclictest6912-21taskset08:58:203
159499643,47cyclictest17696-21chrt10:13:083
159499643,30cyclictest11515-21chrt10:56:053
159499642,49cyclictest2121-21taskset08:44:113
159499642,49cyclictest2121-21taskset08:44:113
159499642,32cyclictest2681-21chrt09:48:023
159499642,31cyclictest8792-21chrt07:25:303
1588996446,12cyclictest297-21systemd-logind08:30:122
1588996444,14cyclictest22749-21latency_hist12:10:142
1588996444,14cyclictest200-21systemd-journal08:25:132
158899643,47cyclictest14118-21sendmail_mailst07:40:442
1588996429,21cyclictest2479-21apt-get08:45:252
1588996429,21cyclictest2479-21apt-get08:45:252
158899642,37cyclictest8568-21head09:01:042
158899642,34cyclictest7488-21/usr/sbin/munin10:50:322
1588996417,35cyclictest15089-21sort07:45:222
159499633,47cyclictest2766-21chrt07:06:023
159499633,47cyclictest2766-21chrt07:06:023
159499633,31cyclictest3661-21chrt08:48:203
159499633,31cyclictest3661-21chrt08:48:203
159499632,49cyclictest4806-21chrt07:11:083
159499632,49cyclictest19411-21chrt07:56:483
159499632,49cyclictest19411-21chrt07:56:483
159499632,48cyclictest21055-21chrt11:12:193
159499632,36cyclictest32344-21taskset10:37:083
159499632,36cyclictest32344-21taskset10:37:083
159499632,32cyclictest26450-21chrt09:33:553
159499632,31cyclictest10876-21chrt07:30:443
159499632,31cyclictest10876-21chrt07:30:443
1588996339,15cyclictest16258-21kworker/u17:1-events_unbound08:05:112
1588996339,15cyclictest16258-21kworker/u17:1-events_unbound08:05:112
158899633,34cyclictest29045-21/usr/sbin/munin12:20:372
158899632,36cyclictest8926-21diskmemload09:45:472
1588996315,13cyclictest0-21swapper/210:04:112
3264426216,26sleep30-21swapper/307:01:263
159499622,47cyclictest8670-21chrt09:02:093
159499622,47cyclictest6450-21taskset07:16:063
159499622,32cyclictest25870-21chrt08:16:453
159499622,32cyclictest24612-21chrt12:12:003
159499622,28cyclictest28267-21chrt08:25:283
1588996242,11cyclictest0-21swapper/209:10:502
1588996241,16cyclictest1564-21cyclictest08:50:482
158899622,46cyclictest18531-21fschecks_count07:55:332
158899622,46cyclictest18531-21fschecks_count07:55:332
1588996213,38cyclictest9619-21unixbench_singl07:25:482
159499614,44cyclictest13085-21chrt07:38:343
159499613,34cyclictest23701-21taskset09:29:383
159499612,30cyclictest12239-21chrt09:10:243
1588996145,9cyclictest0-21swapper/212:35:122
1588996145,9cyclictest0-21swapper/212:35:122
159499603,28cyclictest14555-21chrt07:41:463
159499603,27cyclictest4039-21chrt12:31:533
159499603,27cyclictest4039-21chrt12:31:533
1588996039,12cyclictest0-21swapper/207:20:482
158899603,39cyclictest29822-21/usr/sbin/munin08:30:272
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional