You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-09 - 08:50
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Sat May 09, 2026 00:44:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3688991283,105cyclictest19530-21apt-get19:46:591
3688991096,77cyclictest7236-21apt-get19:11:501
245021069,69sleep02167-21/usr/sbin/munin18:57:000
36809910456,36cyclictest27162-21apt-get22:21:490
36809910456,36cyclictest27162-21apt-get22:21:490
345021036,15sleep20-21swapper/219:00:452
36809910227,44cyclictest11242-21ssh22:48:270
3230321020,6sleep30-21swapper/323:23:423
3230321020,6sleep30-21swapper/323:23:423
36809910125,25cyclictest7841-21ssh22:42:180
36809910125,25cyclictest7841-21ssh22:42:180
3680999957,32cyclictest5888-21apt-get19:06:470
3680999554,36cyclictest0-21swapper/000:01:430
3680999528,41cyclictest0-21swapper/021:48:520
295929510,57sleep13048-21timerwakeupswit18:57:181
3680999468,17cyclictest3671-21cyclictest23:51:340
3680999464,20cyclictest30142-21apt-get22:26:480
3680999435,22cyclictest31564-21seq21:35:070
3697999347,38cyclictest0-21swapper/221:12:082
3680999360,26cyclictest0-21swapper/019:51:480
3680999333,22cyclictest13657-21diskstats23:47:220
3680999333,22cyclictest13657-21diskstats23:47:220
3697999242,42cyclictest0-21swapper/222:01:542
3688999266,15cyclictest19428-21latency_hist19:46:371
3680999235,22cyclictest2052-21seq22:32:530
3680999164,19cyclictest30668-21apt-get23:21:450
3680999164,19cyclictest30668-21apt-get23:21:450
3680999137,27cyclictest13961-21ssh21:06:180
3680999134,19cyclictest18692-21seq19:42:220
3680999126,40cyclictest0-21swapper/000:09:510
3697999047,33cyclictest0-21swapper/219:41:362
3688998968,12cyclictest300-21rs:main1
3680998937,45cyclictest0-21swapper/020:21:440
3680998937,45cyclictest0-21swapper/020:21:440
368099893,66cyclictest7236-21apt-get19:11:480
3680998922,32cyclictest0-21swapper/000:14:030
3697998846,35cyclictest24810-21kworker/u17:1-xprtiod00:16:492
3697998846,35cyclictest24810-21kworker/u17:1-xprtiod00:16:492
369799883,40cyclictest14374-21/usr/sbin/munin21:06:442
369799883,40cyclictest14374-21/usr/sbin/munin21:06:442
369799882,38cyclictest12509-21ssh21:02:122
3680998833,19cyclictest26349-21seq23:13:460
3680998829,26cyclictest0-21swapper/021:10:390
3680998829,26cyclictest0-21swapper/021:10:390
3697998768,13cyclictest11073-21diskmemload00:27:092
3697998745,34cyclictest0-21swapper/219:21:502
3697998739,42cyclictest9458-21idleruntime-cro20:56:332
3697998738,42cyclictest23732-21idleruntime21:21:562
369799873,6cyclictest0-21swapper/220:11:492
369799873,6cyclictest0-21swapper/220:11:492
3680998769,10cyclictest8108-21apt-get20:51:490
3680998751,25cyclictest26381-21apt-get21:26:430
3697998654,25cyclictest3813-21timerandwakeup21:42:082
3697998642,36cyclictest0-21swapper/220:27:062
3697998639,39cyclictest20851-21munin-plugin-st22:11:352
3697998639,39cyclictest20851-21munin-plugin-st22:11:352
369799863,7cyclictest0-21swapper/222:36:452
369799862,6cyclictest0-21swapper/220:06:452
369799862,6cyclictest0-21swapper/220:06:452
369799862,39cyclictest4076-21latency_hist23:31:362
3680998645,36cyclictest0-21swapper/023:36:450
3680998645,36cyclictest0-21swapper/023:36:450
3680998636,40cyclictest23944-21/usr/sbin/munin21:22:010
3680998634,41cyclictest18558-21ssh21:12:180
369799854,7cyclictest0-21swapper/223:36:452
369799854,7cyclictest0-21swapper/223:36:452
369799853,8cyclictest0-21swapper/221:46:462
369799853,7cyclictest0-21swapper/221:26:472
369799853,38cyclictest1-21systemd23:16:342
369799853,36cyclictest5271-21grep19:06:362
369799853,35cyclictest23305-21/usr/sbin/munin19:57:012
369799853,31cyclictest23096-21/usr/sbin/munin00:02:052
3680998551,20cyclictest32461-21apt-get20:26:430
3680998547,31cyclictest0-21swapper/020:11:490
3680998547,31cyclictest0-21swapper/020:11:490
3680998536,17cyclictest28890-21seq23:17:310
3680998535,22cyclictest10903-21ssh21:53:540
3680998523,28cyclictest0-21swapper/022:07:070
3680998523,28cyclictest0-21swapper/022:07:070
3697998467,11cyclictest19245-21apt-key19:46:362
369799844,8cyclictest0-21swapper/219:51:482
369799843,34cyclictest29187-21/usr/sbin/munin00:12:072
369799843,30cyclictest277-21dbus-daemon22:46:332
369799843,30cyclictest277-21dbus-daemon22:46:332
369799842,37cyclictest21362-21ssh22:11:512
369799842,32cyclictest16438-21ssh23:51:472
3680998443,28cyclictest0-21swapper/022:51:480
3680998443,28cyclictest0-21swapper/022:51:480
3680998432,19cyclictest15601-21seq19:34:000
3680998427,23cyclictest22115-21/usr/sbin/munin00:01:340
3680998421,30cyclictest0-21swapper/022:39:240
3697998340,37cyclictest0-21swapper/200:06:502
369799833,7cyclictest0-21swapper/222:21:482
369799833,7cyclictest0-21swapper/222:21:482
369799833,37cyclictest30645-21/usr/sbin/munin23:21:522
369799833,37cyclictest30645-21/usr/sbin/munin23:21:522
369799833,32cyclictest9947-21/usr/sbin/munin22:46:542
369799832,39cyclictest9145-21runrttasks19:16:342
3688998360,14cyclictest28964-21kworker/u17:2-rpciod21:09:161
3688998360,14cyclictest28964-21kworker/u17:2-rpciod21:09:161
3688998357,17cyclictest11073-21diskmemload23:43:081
3688998357,17cyclictest11073-21diskmemload23:43:081
3680998340,35cyclictest3901-21awk23:31:330
3680998337,21cyclictest21424-21ssh22:11:530
3680998336,40cyclictest24580-21cut22:16:570
3680998336,38cyclictest5149-21rm21:45:160
3680998335,39cyclictest12119-21ssh21:56:370
3680998335,39cyclictest12119-21ssh21:56:370
369799823,7cyclictest0-21swapper/222:26:482
369799823,39cyclictest31785-21/usr/sbin/munin20:22:092
369799823,39cyclictest31785-21/usr/sbin/munin20:22:092
369799823,34cyclictest6643-21/usr/sbin/munin20:46:542
369799823,34cyclictest29377-21/usr/sbin/munin21:32:102
369799823,32cyclictest4847-21/usr/sbin/munin20:42:062
369799823,31cyclictest29231-21/usr/sbin/munin20:17:062
369799823,31cyclictest29231-21/usr/sbin/munin20:17:062
369799823,23cyclictest24163-21apt-get22:16:432
369799822,40cyclictest4147-21ssh00:25:112
369799822,38cyclictest25748-21modprobe20:06:332
369799822,37cyclictest3422-21ssh22:36:352
369799822,36cyclictest27698-21chrt23:16:482
369799822,36cyclictest16304-21sed23:51:362
369799822,28cyclictest19380-21/usr/sbin/munin23:56:592
3680998264,10cyclictest1643-21apt-get20:31:430
3680998259,15cyclictest18672-21apt-get23:01:430
3680998259,15cyclictest18672-21apt-get23:01:430
3680998253,22cyclictest29249-21apt-get20:16:440
3680998253,22cyclictest29249-21apt-get20:16:440
3680998245,29cyclictest0-21swapper/022:56:490
3680998241,31cyclictest17837-21grep22:06:320
3680998237,37cyclictest31327-21ssh00:16:370
3680998237,37cyclictest31327-21ssh00:16:370
3680998233,39cyclictest22055-21ssh21:18:440
3680998221,34cyclictest0-21swapper/000:22:290
369799814,30cyclictest23110-21ssh21:21:342
369799813,38cyclictest14060-21cat19:31:352
369799813,35cyclictest765-21sed21:37:072
369799813,34cyclictest9534-21/usr/sbin/munin19:16:532
369799813,30cyclictest9162-21/usr/sbin/munin21:53:052
369799813,29cyclictest7239-21latency_hist19:11:362
369799812,39cyclictest20866-21cron19:51:332
369799812,33cyclictest12588-21ssh21:56:582
369799812,33cyclictest12588-21ssh21:56:582
369799812,32cyclictest16374-21/usr/sbin/munin22:57:062
369799812,32cyclictest13451-21/usr/sbin/munin22:52:072
369799812,32cyclictest13451-21/usr/sbin/munin22:52:072
3688998148,24cyclictest4767-21latency_hist00:26:351
3680998158,15cyclictest12485-21latency_hist19:26:360
3680998156,20cyclictest0-21swapper/020:41:430
3680998153,20cyclictest4196-21apt-get23:31:430
3680998152,22cyclictest21657-21apt-get23:06:430
370199804,62cyclictest24858-21taskset23:11:503
369799803,37cyclictest11148-21latency_hist21:01:352
369799803,32cyclictest5200-21ssh23:32:092
369799803,32cyclictest22449-21/usr/sbin/munin23:07:062
369799803,32cyclictest10379-21acpi23:41:432
369799803,32cyclictest10379-21acpi23:41:432
369799802,34cyclictest15419-21grep19:32:562
369799802,32cyclictest4161-21tail20:37:082
369799802,31cyclictest18703-21/usr/sbin/munin23:01:482
369799802,31cyclictest18703-21/usr/sbin/munin23:01:482
3680998032,25cyclictest19028-21apt-get19:46:440
369799792,30cyclictest2492-21sed20:32:072
3680997962,11cyclictest24839-21runrttasks20:01:580
3680997952,21cyclictest0-21swapper/019:26:480
3680997937,31cyclictest0-21swapper/000:26:450
3688997855,15cyclictest27627-21/usr/sbin/munin20:12:061
3688997855,15cyclictest27627-21/usr/sbin/munin20:12:061
3688997852,18cyclictest3671-21cyclictest21:16:541
368899775,61cyclictest9078-21kworker/u17:3+ext4-rsv-conversion19:32:091
3688997748,19cyclictest2129-21sh22:33:051
3680997741,27cyclictest32634-21cut21:36:540
3680997737,17cyclictest16418-21apt-get23:51:480
3680997733,22cyclictest5023-21seq19:04:350
370199764,60cyclictest19999-21chrt23:57:013
3680997639,28cyclictest11111-21munin-run21:01:340
3680997637,28cyclictest3229-21/usr/sbin/munin20:37:110
368899757,52cyclictest9184-21apt-get21:52:131
3688997551,16cyclictest2374-21systemd-journal23:26:061
3688997551,16cyclictest2374-21systemd-journal23:26:061
3688997537,23cyclictest31-21ksoftirqd/123:57:301
3680997542,26cyclictest0-21swapper/019:16:470
3680997540,25cyclictest16859-21sed19:37:090
368899747,34cyclictest31-21ksoftirqd/121:33:431
3688997456,9cyclictest4337-21kworker/u17:1-rpciod21:45:441
3688997456,12cyclictest28038-21cron00:11:331
3688997456,11cyclictest7417-21fschecks_count23:36:541
3688997456,11cyclictest7417-21fschecks_count23:36:541
370199733,37cyclictest6390-21chrt20:46:363
370199733,37cyclictest17476-21taskset21:11:473
3688997352,12cyclictest0-21swapper/121:47:051
3688997349,16cyclictest297-21systemd-logind20:36:341
3688997337,11cyclictest12515-21ssh21:56:561
3688997337,11cyclictest12515-21ssh21:56:561
3688997328,29cyclictest31-21ksoftirqd/121:12:061
3688997320,20cyclictest4665-21cat22:37:081
3680997357,9cyclictest22788-21apt-get19:56:460
3680997340,26cyclictest6646-21cut20:46:540
3680997337,27cyclictest27368-21basename20:11:330
3680997337,27cyclictest27368-21basename20:11:330
370199724,56cyclictest885-21chrt21:37:083
3688997250,13cyclictest0-21swapper/122:17:091
3688997246,17cyclictest3528-21cut20:36:551
370199713,36cyclictest15163-21chrt22:01:443
370199713,35cyclictest27390-21chrt20:11:333
370199713,35cyclictest27390-21chrt20:11:333
370199713,35cyclictest13955-21chrt23:47:373
3688997119,31cyclictest31-21ksoftirqd/121:30:301
370199703,37cyclictest1666-21taskset22:32:073
370199703,36cyclictest29999-21chrt00:13:353
370199703,34cyclictest9849-21chrt22:46:503
370199703,34cyclictest23038-21chrt19:56:553
3688997055,10cyclictest20846-21sendmail22:11:331
3688997055,10cyclictest20846-21sendmail22:11:331
3688997043,15cyclictest0-21swapper/120:31:361
368899702,30cyclictest25224-21ssh23:11:591
3688997022,25cyclictest31-21ksoftirqd/100:17:431
3688997022,25cyclictest31-21ksoftirqd/100:17:431
370199693,35cyclictest31017-21chrt20:21:543
370199693,35cyclictest31017-21chrt20:21:543
370199693,35cyclictest23796-21chrt00:03:013
370199693,34cyclictest3471-21chrt23:30:303
370199693,34cyclictest22689-21chrt21:20:313
370199693,34cyclictest19056-21chrt19:46:343
3688996945,18cyclictest352-21runrttasks21:37:581
3688996944,19cyclictest14171-21apt-key19:31:361
368899693,43cyclictest30766-21latency_hist20:21:361
368899693,43cyclictest30766-21latency_hist20:21:361
3688996925,14cyclictest291rcuc/119:21:541
370199688,47cyclictest0-21swapper/300:06:443
370199684,32cyclictest11115-21chrt21:01:343
370199683,33cyclictest11609-21chrt21:55:523
370199682,35cyclictest6480-21taskset20:46:483
3688996849,13cyclictest21349-21fschecks_count19:51:541
3688996846,12cyclictest0-21swapper/119:06:531
3688996835,7cyclictest181rcu_preempt21:03:481
368899683,33cyclictest22661-21fschecks_count00:01:541
368899682,47cyclictest352-21runrttasks19:18:521
368899682,45cyclictest15833-21grep22:02:051
370199673,35cyclictest6711-21chrt00:28:593
370199673,34cyclictest7027-21taskset21:47:093
370199672,34cyclictest2126-21chrt00:21:543
3688996745,12cyclictest1915-21kworker/u19:0+events_unbound22:51:321
3688996744,15cyclictest0-21swapper/120:21:581
3688996744,15cyclictest0-21swapper/120:21:581
3688996740,8cyclictest181rcu_preempt23:04:491
3688996740,8cyclictest181rcu_preempt23:04:491
3688996739,14cyclictest0-21swapper/123:11:361
368899673,42cyclictest4758-21tail19:02:091
370199662,34cyclictest29859-21chrt23:20:133
368899665,37cyclictest31-21ksoftirqd/122:57:561
3688996646,10cyclictest0-21swapper/122:41:481
3688996646,10cyclictest0-21swapper/122:41:481
3688996641,13cyclictest0-21swapper/123:52:091
3688996634,9cyclictest181rcu_preempt22:25:491
3688996634,9cyclictest181rcu_preempt22:25:491
3688996630,19cyclictest452-21latency_hist22:31:351
3688996622,28cyclictest31-21ksoftirqd/122:52:071
3688996622,28cyclictest31-21ksoftirqd/122:52:071
3688996622,13cyclictest181rcu_preempt23:21:321
3688996620,21cyclictest291rcuc/120:01:511
370199656,47cyclictest0-21swapper/323:47:143
370199656,47cyclictest0-21swapper/323:47:143
370199653,35cyclictest6879-21chrt22:41:523
370199653,35cyclictest6879-21chrt22:41:523
370199653,32cyclictest29615-21taskset22:25:593
370199653,32cyclictest29615-21taskset22:25:593
370199653,26cyclictest19770-21chrt23:02:103
370199653,26cyclictest19770-21chrt23:02:103
3688996549,11cyclictest16119-40mandb23:51:331
368899653,48cyclictest4977-21cat20:41:491
368899653,42cyclictest10645-21tail20:57:081
3688996530,9cyclictest181rcu_preempt20:52:571
3688996520,34cyclictest1272-21cat23:26:481
370199643,29cyclictest24044-21taskset21:22:053
370199643,25cyclictest15840-21chrt19:36:343
370199642,38cyclictest19667-21chrt22:08:213
370199642,38cyclictest19667-21chrt22:08:213
368899646,26cyclictest31-21ksoftirqd/122:11:461
3688996442,14cyclictest26219-21fschecks_time20:06:541
3688996442,14cyclictest26219-21fschecks_time20:06:541
368899642,41cyclictest17409-21kworker/u18:019:41:331
368899642,36cyclictest31-21ksoftirqd/121:22:381
370199633,32cyclictest1129-21chrt00:20:153
370199633,32cyclictest1129-21chrt00:20:153
370199633,31cyclictest27667-21chrt21:27:403
370199633,25cyclictest19557-21chrt19:46:593
370199633,24cyclictest23026-21chrt22:14:163
370199632,37cyclictest13450-21chrt21:57:393
370199632,37cyclictest13450-21chrt21:57:393
370199632,32cyclictest23554-21chrt23:09:233
370199632,27cyclictest16139-21chrt19:36:503
3701996310,41cyclictest0-21swapper/319:06:473
368899635,34cyclictest31-21ksoftirqd/119:56:581
370199623,26cyclictest14084-21chrt19:31:363
370199623,25cyclictest1874-21chrt20:31:543
370199622,27cyclictest17898-21taskset23:53:123
370199622,25cyclictest31528-21chrt22:27:583
370199616,8cyclictest0-21swapper/322:56:493
370199614,25cyclictest24465-21chrt20:01:493
370199613,34cyclictest32470-21taskset20:26:483
370199613,27cyclictest7201-21taskset23:36:463
370199613,27cyclictest7201-21taskset23:36:463
370199613,25cyclictest17016-21chrt21:11:273
370199613,25cyclictest17016-21chrt21:11:273
370199613,22cyclictest5416-21chrt23:32:293
370199613,22cyclictest22283-21chrt19:53:393
370199612,25cyclictest3556-21chrt21:42:033
368899612,26cyclictest31-21ksoftirqd/100:28:321
3688996117,17cyclictest291rcuc/100:15:271
370199604,8cyclictest0-21swapper/319:21:493
370199603,9cyclictest0-21swapper/322:16:453
370199603,26cyclictest8642-21chrt19:12:573
370199603,25cyclictest30503-21chrt20:20:363
370199603,25cyclictest30503-21chrt20:20:363
370199603,22cyclictest13953-21chrt21:06:163
370199602,23cyclictest8194-21chrt20:51:503
370199602,23cyclictest3863-21chrt20:37:043
370199602,22cyclictest29373-21chrt21:31:413
368899602,35cyclictest31-21ksoftirqd/123:35:541
370199593,26cyclictest5110-21chrt19:05:443
370199593,24cyclictest14306-21chrt22:53:353
370199593,24cyclictest14306-21chrt22:53:353
370199593,22cyclictest5478-21chrt22:39:043
370199593,22cyclictest28894-21chrt20:15:343
370199593,22cyclictest28894-21chrt20:15:343
370199592,20cyclictest10485-21chrt19:18:443
285225614,24sleep30-21swapper/318:57:163
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional