You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-07 - 21:05
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot7.osadl.org (updated Thu May 07, 2026 12:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
27649213010,37sleep11-21systemd07:01:411
2630321180,8sleep10-21swapper/111:27:011
2630321180,8sleep10-21swapper/111:27:011
277669911737,12cyclictest0-21swapper/010:12:110
277669911653,57cyclictest3048-21kworker/u18:2+events_unbound08:16:390
98021150,5sleep10-21swapper/111:38:081
277669911540,10cyclictest0-21swapper/010:02:110
277669911434,22cyclictest0-21swapper/012:21:400
277669911355,53cyclictest27754-21cyclictest08:32:390
27766991113,56cyclictest8120-21ssh11:51:230
27766991104,40cyclictest17687-21fschecks_time11:12:580
27766991072,31cyclictest2609-21latency_hist09:01:420
27766991072,31cyclictest2609-21latency_hist09:01:420
277719910340,9cyclictest0-21swapper/111:47:021
277719910285,11cyclictest2451-21diskmemload10:58:081
277669910145,10cyclictest352-21runrttasks08:06:480
277669910138,11cyclictest27754-21cyclictest07:31:500
277669910138,11cyclictest27754-21cyclictest07:31:500
2262521000,6sleep10-21swapper/108:22:121
27771999951,41cyclictest2374-21systemd-journal07:28:561
27771999951,41cyclictest2374-21systemd-journal07:28:561
2777599984,80cyclictest16474-21apt-get11:11:542
27771999736,9cyclictest0-21swapper/112:27:031
27771999727,13cyclictest0-21swapper/109:42:041
27771999646,43cyclictest13259-21sh11:06:391
27771999646,43cyclictest13259-21sh11:06:391
27771999640,9cyclictest0-21swapper/108:12:141
27771999638,7cyclictest0-21swapper/109:06:551
27771999638,7cyclictest0-21swapper/109:06:551
27771999637,12cyclictest0-21swapper/111:16:391
2776699964,42cyclictest10547-21apt-get11:01:590
2776699964,42cyclictest10547-21apt-get11:01:590
2777599953,60cyclictest7331-21apt-get10:57:032
27771999549,41cyclictest27754-21cyclictest07:52:001
2776699953,39cyclictest26580-21apt-get08:36:440
2776699953,39cyclictest26580-21apt-get08:36:440
2777599943,68cyclictest13960-21taskset11:07:192
2777599943,68cyclictest13960-21taskset11:07:192
27771999438,7cyclictest0-21swapper/109:12:081
2777199943,37cyclictest7957-21ls07:37:141
2777199943,36cyclictest29993-21/usr/sbin/munin09:48:071
2777199943,34cyclictest2451-21diskmemload10:22:511
2777199943,34cyclictest2451-21diskmemload10:22:511
27771999347,39cyclictest0-21swapper/112:00:431
27771999343,44cyclictest32248-21mailstats07:12:131
27771999337,13cyclictest0-21swapper/110:12:041
27771999334,12cyclictest0-21swapper/108:02:151
2777199933,31cyclictest30526-21/usr/sbin/munin10:42:041
2777599923,77cyclictest30434-21/usr/sbin/munin09:47:522
27771999272,13cyclictest11007-21kworker/u19:2-flush-179:008:07:591
2777199923,33cyclictest27422-21fschecks_time08:37:571
2777199923,33cyclictest27422-21fschecks_time08:37:571
2777199922,34cyclictest18177-21ssh09:27:031
2777199922,34cyclictest18177-21ssh09:27:031
27775999167,15cyclictest18654-21ssh10:21:552
27775999167,15cyclictest18654-21ssh10:21:552
2777199913,34cyclictest5131-21ssh09:05:491
27771999128,11cyclictest0-21swapper/110:32:131
2777199904,30cyclictest3522-21timerwakeupswit11:42:141
2777199904,30cyclictest3522-21timerwakeupswit11:42:141
27771999041,12cyclictest352-21runrttasks10:07:441
27771999039,11cyclictest0-21swapper/111:35:271
2777199903,37cyclictest21807-21unixbench_multi09:32:161
2777199903,33cyclictest16522-21timerwakeupswit10:17:151
27771999029,10cyclictest0-21swapper/107:07:161
2777199902,36cyclictest28310-21kernelversion07:02:041
133862900,25sleep239-21ksoftirqd/210:12:132
27775998962,19cyclictest22902-21ssh11:21:432
27775998962,19cyclictest22902-21ssh11:21:432
2777599893,61cyclictest11000-21ssh11:02:412
2777599893,61cyclictest11000-21ssh11:02:412
2777199893,36cyclictest352-21runrttasks08:19:071
2777199893,34cyclictest1519-21rm10:47:051
2777199892,35cyclictest4097-21apt10:51:491
27766998960,22cyclictest27754-21cyclictest10:27:140
27771998861,10cyclictest181rcu_preempt10:26:511
2777199885,34cyclictest7231-21ssh10:02:111
2777199883,35cyclictest2374-21systemd-journal07:36:391
2777199883,35cyclictest2374-21systemd-journal07:36:391
27775998761,15cyclictest30753-21ssh10:41:592
2777199873,33cyclictest24235-21latency09:37:051
2777199873,30cyclictest14833-21fschecks_count12:02:011
2777199863,33cyclictest32113-21cut08:51:591
2777199863,33cyclictest23542-21/usr/sbin/munin12:17:031
2777199863,32cyclictest20543-21/usr/sbin/munin12:12:091
2777199863,29cyclictest14766-21/usr/sbin/munin09:22:021
2777199862,33cyclictest10538-21cstates07:46:571
27771998621,24cyclictest14885-21sshd07:59:561
27775998557,20cyclictest8995-21sh09:11:592
2777199853,38cyclictest9093-21fschecks_time07:42:001
2777199853,35cyclictest23585-21/usr/sbin/munin08:27:101
2777199852,33cyclictest5950-21rm10:00:511
2777199852,33cyclictest5950-21rm10:00:511
2776699855,36cyclictest13780-21apt-get11:06:540
2776699855,36cyclictest13780-21apt-get11:06:540
27771998461,13cyclictest0-21swapper/108:32:001
2777199842,35cyclictest352-21runrttasks11:17:251
2777199842,35cyclictest352-21runrttasks11:17:251
27766998455,20cyclictest28120-21fschecks_count07:02:010
2777599833,51cyclictest17138-21apt-get08:07:072
2777199833,34cyclictest17520-21/usr/sbin/munin12:07:021
2777199832,31cyclictest530-21/usr/sbin/munin09:51:561
235082830,19sleep2381ktimers/211:22:042
27775998257,19cyclictest544-21cron11:51:392
27775998255,18cyclictest17467-21munin-run09:26:392
27775998241,31cyclictest1662-21grep07:17:152
2777199825,33cyclictest16772-21latency_hist11:11:421
2777199825,33cyclictest16772-21latency_hist11:11:421
27766998251,23cyclictest25640-21unixbench_singl10:32:160
27766998240,33cyclictest0-21swapper/012:01:380
27775998115,16cyclictest12100-21fschecks_time09:17:022
27775998115,16cyclictest12100-21fschecks_time09:17:022
2777199814,30cyclictest23269-21fschecks_count11:22:001
2777199813,34cyclictest11482-21latency_hist11:56:421
2777199813,34cyclictest11482-21latency_hist11:56:421
2777199812,35cyclictest1520-21switchtime07:17:141
27766998153,18cyclictest18842-21fschecks_time10:22:010
27766998153,18cyclictest18842-21fschecks_time10:22:010
27766998148,11cyclictest181rcu_preempt09:16:250
27766998148,10cyclictest181rcu_preempt07:41:540
27775998058,14cyclictest26861-21apt-key08:36:432
27775998058,12cyclictest0-21swapper/209:27:012
27775998058,12cyclictest0-21swapper/209:27:012
27766997955,18cyclictest364-21unixbench_multi08:52:140
27775997859,13cyclictest14257-21kworker/u19:012:01:382
27775997856,13cyclictest23358-21kworker/u17:0-rpciod11:27:052
27775997856,13cyclictest23358-21kworker/u17:0-rpciod11:27:052
27775997855,16cyclictest27754-21cyclictest09:44:312
2777599783,46cyclictest21855-21ssh10:27:002
27766997861,9cyclictest30753-21ssh10:41:590
27766997856,16cyclictest352-21runrttasks10:10:010
2778199772,65cyclictest17396-21taskset11:12:493
27775997751,17cyclictest30734-21threads07:07:172
2777199773,32cyclictest11766-21/usr/sbin/munin09:17:141
2777199773,32cyclictest11766-21/usr/sbin/munin09:17:141
27771997724,22cyclictest27397-21sed12:22:131
2777599769,27cyclictest0-21swapper/208:12:132
27775997659,12cyclictest3503-21kworker/u17:3-rpciod11:46:422
27775997659,12cyclictest3503-21kworker/u17:3-rpciod11:46:422
27766997654,15cyclictest27754-21cyclictest11:39:090
27766997645,17cyclictest24647-21kworker/u19:1-events_unbound07:22:110
27775997511,45cyclictest27080-21apt-get08:36:562
27775997511,45cyclictest27080-21apt-get08:36:562
27771997545,9cyclictest181rcu_preempt10:39:431
27766997557,12cyclictest9235-21ssh10:59:310
27766997557,10cyclictest27754-21cyclictest12:05:130
27766997515,27cyclictest4338-21ssh10:52:000
27775997454,11cyclictest29529-21munin-node10:10:332
27775997451,12cyclictest0-21swapper/207:52:002
27775997447,19cyclictest352-21runrttasks10:37:112
2777599743,53cyclictest3299-21grep07:22:162
27771997456,9cyclictest0-21swapper/108:46:421
27766997450,17cyclictest27754-21cyclictest11:27:560
27766997450,17cyclictest27754-21cyclictest11:27:560
2776699744,38cyclictest26535-21/usr/sbin/munin12:22:160
27766997440,13cyclictest181rcu_preempt07:06:560
2645627410,41sleep226512-21/usr/sbin/munin06:57:052
27771997350,14cyclictest0-21swapper/107:22:011
27766997354,14cyclictest21081-21fschecks_time09:32:010
27766997348,17cyclictest12299-21fschecks_time07:52:000
27766997345,20cyclictest15430-21open_files09:22:100
2776699734,37cyclictest30104-21rm09:47:060
2637027320,29sleep00-21swapper/006:56:590
27775997255,11cyclictest298-21in:imuxsock08:51:392
27775997252,14cyclictest17813-21fschecks_time12:06:592
27775997245,21cyclictest28916-21uptime07:02:162
27775997244,21cyclictest27754-21cyclictest12:27:152
2777599723,47cyclictest25101-21latency_hist08:31:422
27775997221,40cyclictest23906-21basename12:17:022
2776699725,35cyclictest28461-21/usr/sbin/munin10:37:140
27766997251,14cyclictest2451-21diskmemload11:18:290
27766997251,14cyclictest2451-21diskmemload11:18:290
27766997232,31cyclictest0-21swapper/009:56:590
27766997232,31cyclictest0-21swapper/009:56:590
27766997225,34cyclictest25008-21unin-run08:31:400
27781997111,45cyclictest0-21swapper/310:56:563
27775997146,17cyclictest3797-21unixbench_multi09:02:162
2777599713,40cyclictest7982-21threads07:37:142
27766997156,7cyclictest0-21swapper/009:51:590
27766997119,24cyclictest181rcu_preempt07:46:510
305792700,8sleep00-21swapper/011:33:290
27775997040,21cyclictest828-21modprobe08:56:392
2777599703,38cyclictest30004-21ssh11:32:142
27766997053,12cyclictest27754-21cyclictest10:21:390
2776699703,53cyclictest29805-21apt-config09:46:430
27766997032,8cyclictest181rcu_preempt07:16:430
27766997030,30cyclictest8533-21ssh09:11:410
27766997030,30cyclictest8533-21ssh09:11:410
27775996945,13cyclictest0-21swapper/210:46:562
27775996932,28cyclictest11468-21kworker/u19:0+nfsiod09:32:462
27766996946,14cyclictest4300-21ssh09:03:280
2778199683,39cyclictest0-21swapper/309:47:013
27775996852,10cyclictest277-21dbus-daemon12:16:402
2777599683,44cyclictest1103-21apt-get08:56:572
2777599683,44cyclictest1103-21apt-get08:56:572
27766996842,10cyclictest181rcu_preempt07:16:520
27766996840,11cyclictest181rcu_preempt11:55:180
27766996840,11cyclictest181rcu_preempt11:55:180
2776699683,49cyclictest16872-21apt-key08:06:410
27775996746,11cyclictest0-21swapper/210:31:512
27775996743,12cyclictest0-21swapper/210:56:432
2777599673,44cyclictest3965-21/usr/sbin/munin07:26:572
2777599673,44cyclictest3965-21/usr/sbin/munin07:26:572
27775996724,32cyclictest10212-21cat07:46:412
2776699673,51cyclictest31187-21ssh12:28:440
27775996650,10cyclictest27125-21ntp_kernel_pll_12:22:062
27775996647,13cyclictest352-21runrttasks10:02:052
27775996645,11cyclictest0-21swapper/207:16:432
2777599664,32cyclictest13989-21idleruntime07:57:042
2777599663,46cyclictest10688-21fschecks_time07:47:022
2777599663,41cyclictest11483-21latency_hist11:56:422
2777599663,41cyclictest11483-21latency_hist11:56:422
27775996622,33cyclictest24082-21fschecks_time09:37:002
27766996642,15cyclictest24440-21sh09:37:120
2776699662,26cyclictest30563-21grep08:47:020
81082652,52sleep07203-21/usr/sbin/munin07:37:160
27775996544,12cyclictest0-21swapper/208:17:162
2777599654,37cyclictest352-21runrttasks09:10:432
2777599654,37cyclictest352-21runrttasks09:10:432
2777599653,41cyclictest854-21fschecks_time09:51:592
27771996539,14cyclictest0-21swapper/108:46:421
27766996545,10cyclictest0-21swapper/009:17:130
27766996545,10cyclictest0-21swapper/009:17:130
27766996542,15cyclictest19676-21snmpd10:50:170
2776699653,46cyclictest12842-21kworker/u17:1+xprtiod12:14:560
2776699653,31cyclictest18103-21ntp_kernel_err12:07:050
310882640,5sleep10-21swapper/108:47:151
27775996447,10cyclictest23363-21systemd-run08:26:402
2776699644,49cyclictest18875-21/usr/sbin/munin09:27:160
2776699644,49cyclictest18875-21/usr/sbin/munin09:27:160
2776699644,36cyclictest21737-21idleruntime-cro08:21:390
2776699643,30cyclictest23297-21grep11:22:000
27775996345,13cyclictest0-21swapper/212:02:052
2777599633,44cyclictest1082-21ssh11:38:252
2777599633,43cyclictest4509-21cat09:57:152
2777599633,43cyclictest4509-21cat09:57:152
2777599633,34cyclictest15555-21fschecks_time08:02:022
27766996340,9cyclictest3268-21ssh11:42:120
27766996340,9cyclictest3268-21ssh11:42:120
2776699625,29cyclictest22526-21ntpq08:22:070
27766996243,13cyclictest300-21rs:main0
2776699622,43cyclictest4951-21grep07:27:170
2776699622,43cyclictest4951-21grep07:27:170
2767426211,32sleep30-21swapper/307:01:433
27775996139,14cyclictest0-21swapper/210:17:152
27775996138,13cyclictest0-21swapper/207:32:052
27775996138,13cyclictest0-21swapper/207:32:052
2777599612,43cyclictest28800-21wc08:41:562
2777599612,43cyclictest28800-21wc08:41:562
27771996143,13cyclictest58-21kcompactd009:01:421
27771996143,13cyclictest58-21kcompactd009:01:421
27766996119,11cyclictest27754-21cyclictest08:42:130
27766996119,11cyclictest27754-21cyclictest08:42:130
27781995916,31cyclictest0-21swapper/311:02:193
27781995916,31cyclictest0-21swapper/311:02:193
27781995835,16cyclictest0-21swapper/311:07:043
27781995835,16cyclictest0-21swapper/311:07:043
2778199564,38cyclictest27234-21chrt12:22:113
2778199563,37cyclictest31502-21taskset07:11:423
27781995611,28cyclictest19839-21chrt10:22:443
27781995611,28cyclictest19839-21chrt10:22:443
2778199552,44cyclictest30257-21taskset11:32:353
2778199552,39cyclictest23334-21taskset08:26:393
2778199545,39cyclictest786-21taskset10:46:393
2778199544,35cyclictest20394-21taskset12:11:413
2778199543,39cyclictest27420-21taskset08:37:573
2778199543,39cyclictest27420-21taskset08:37:573
2778199543,39cyclictest10413-21taskset11:54:193
2778199543,39cyclictest10413-21taskset11:54:193
2778199543,38cyclictest2867-21chrt07:22:073
2778199543,37cyclictest12204-21taskset11:57:103
2778199543,36cyclictest20627-21chrt09:31:423
2778199543,36cyclictest20627-21chrt09:31:423
2778199543,36cyclictest20358-21chrt08:16:433
2778199543,35cyclictest2491-21taskset11:41:423
2778199533,39cyclictest9850-21taskset09:12:173
2778199533,38cyclictest26483-21chrt09:41:393
2778199533,38cyclictest12771-21taskset10:11:583
2778199533,36cyclictest15428-21chrt08:01:563
2778199523,35cyclictest29720-21chrt12:26:573
2778199523,35cyclictest15952-21taskset09:22:263
2778199523,34cyclictest1735-21taskset10:47:123
2778199522,39cyclictest4888-21taskset09:05:073
2778199522,38cyclictest27365-21chrt10:36:423
2778199522,35cyclictest17996-21chrt08:08:123
2778199515,33cyclictest6694-21chrt11:47:223
2778199514,34cyclictest20134-21chrt11:16:543
2778199514,34cyclictest20134-21chrt11:16:543
2778199513,37cyclictest23533-21chrt12:16:483
2778199513,36cyclictest7912-21taskset09:10:103
2778199513,36cyclictest7912-21taskset09:10:103
2778199512,37cyclictest16285-21chrt12:03:593
2778199512,35cyclictest16787-21chrt10:17:333
2778199503,36cyclictest26000-21taskset08:32:143
2778199503,34cyclictest4396-21chrt07:27:063
2778199503,34cyclictest4396-21chrt07:27:063
2778199502,35cyclictest7056-21chrt07:36:413
2778199502,35cyclictest7056-21chrt07:36:413
2778199502,33cyclictest1597-21chrt08:57:093
2778199502,33cyclictest1597-21chrt08:57:093
2778199493,35cyclictest28854-21chrt08:41:583
2778199493,35cyclictest28854-21chrt08:41:583
2778199493,35cyclictest22894-21chrt10:27:553
2778199493,33cyclictest5927-21chrt10:54:173
2778199493,33cyclictest2683-21chrt09:55:043
2778199493,30cyclictest31855-21chrt08:51:423
2778199484,34cyclictest23022-21chrt11:21:493
2778199484,33cyclictest12386-21chrt10:11:423
2778199483,33cyclictest6123-21chrt10:01:203
2778199483,33cyclictest6123-21chrt10:01:203
2778199483,32cyclictest28589-21chrt10:37:153
2778199483,32cyclictest23205-21chrt09:35:563
2778199482,33cyclictest4413-21chrt11:44:223
2778199482,33cyclictest4413-21chrt11:44:223
2778199473,33cyclictest1472-21chrt07:17:133
2778199473,31cyclictest22706-21taskset12:15:103
2778199463,29cyclictest31977-21taskset08:51:543
2778199462,30cyclictest14422-21chrt09:21:333
2778199462,30cyclictest14422-21chrt09:21:333
2778199454,28cyclictest26727-21taskset09:41:433
2778199453,33cyclictest28824-21taskset11:31:413
2778199453,33cyclictest28824-21taskset11:31:413
2778199453,31cyclictest31915-21chrt07:12:033
2778199453,31cyclictest13524-21chrt07:56:423
2778199453,30cyclictest6542-21chrt10:01:493
2778199443,26cyclictest7502-21chrt07:37:023
2778199442,30cyclictest9368-21chrt07:42:083
2778199433,31cyclictest24226-21chrt08:27:123
2778199433,27cyclictest14136-21chrt07:57:063
27781994331,8cyclictest451rcuc/308:17:453
2778199432,28cyclictest28808-21chrt07:02:153
2778199404,25cyclictest11169-21chrt07:47:143
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional