You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-04 - 05:10
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot7.osadl.org (updated Sat Jul 04, 2026 00:45:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1689021909,81sleep216908-21munin-run18:57:482
16991991145,38cyclictest17846-21apt-get00:23:020
16991991135,32cyclictest2812-21sshd23:03:160
16991991135,32cyclictest2812-21sshd23:03:160
169919911256,50cyclictest29423-21ssh22:53:190
169919911245,8cyclictest0-21swapper/022:28:140
16991991084,42cyclictest27414-21/usr/sbin/munin21:03:060
16991991083,28cyclictest1743-21sendmail_mailst21:13:210
169919910831,9cyclictest0-21swapper/022:36:300
169919910822,29cyclictest25990-21cat23:42:480
169919910822,29cyclictest25990-21cat23:42:480
170089910745,33cyclictest9128-21diskmemload22:19:122
169919910740,9cyclictest0-21swapper/023:48:220
169919910717,33cyclictest9903-21latency_hist21:27:480
169919910642,16cyclictest2913-21apt-key19:52:490
169919910638,9cyclictest0-21swapper/023:43:570
16991991063,40cyclictest1232-21lockfile-create22:07:450
16991991063,40cyclictest1232-21lockfile-create22:07:450
169919910633,12cyclictest0-21swapper/000:22:490
169919910633,12cyclictest0-21swapper/000:22:490
169919910547,51cyclictest0-21swapper/021:58:220
16991991054,43cyclictest19160-21fschecks_count19:02:580
16991991054,43cyclictest19160-21fschecks_count19:02:580
169919910539,9cyclictest0-21swapper/023:12:470
169919910442,15cyclictest11003-21fschecks_time22:23:070
169919910440,12cyclictest277-21dbus-daemon20:02:460
16991991034,39cyclictest352-21runrttasks23:28:310
16991991024,41cyclictest24874-21kworker/u17:0+xprtiod21:08:070
16991991024,41cyclictest24874-21kworker/u17:0+xprtiod21:08:070
16991991024,38cyclictest13870-21timerandwakeup21:33:200
170009910153,41cyclictest24120-21diskmemload21:18:021
170009910153,41cyclictest24120-21diskmemload21:18:021
16991991014,35cyclictest352-21runrttasks23:33:060
16991991014,33cyclictest3123-21/usr/sbin/munin19:53:410
16991991013,38cyclictest8431-21cut23:13:050
16991991013,38cyclictest8431-21cut23:13:050
16991991003,29cyclictest3758-21unixbench_singl23:58:220
16991991002,40cyclictest25500-21grep20:58:270
1699199995,35cyclictest25646-21/usr/sbin/munin19:23:170
16991999951,9cyclictest17789-21ssh21:40:220
1699199994,40cyclictest14137-21/usr/sbin/munin23:23:090
1699199993,37cyclictest352-21runrttasks23:18:420
17008999854,39cyclictest0-21swapper/223:52:562
17008999854,39cyclictest0-21swapper/223:52:562
1699199984,38cyclictest17610-21latency_hist20:37:490
16991999838,8cyclictest0-21swapper/022:58:420
16991999838,8cyclictest0-21swapper/022:58:420
1699199983,36cyclictest19038-21apt-key20:42:460
1699199964,39cyclictest1-21systemd19:32:460
1699199964,37cyclictest21657-21ntp_kernel_pll_20:48:130
1699199963,38cyclictest14258-21latency_hist20:27:470
17000999451,36cyclictest11509-21sh22:23:211
1699199934,37cyclictest26679-21unixbench_multi22:48:200
1700899923,80cyclictest0-21swapper/219:48:012
17000999242,44cyclictest0-21swapper/122:03:061
17000999242,44cyclictest0-21swapper/122:03:061
1700099923,43cyclictest22498-21latency_hist20:52:491
1699199922,40cyclictest15791-21ls20:32:450
276022910,7sleep20-21swapper/219:28:092
17008999070,13cyclictest352-21runrttasks20:43:332
17008999070,13cyclictest352-21runrttasks20:43:332
1700099903,38cyclictest1-21systemd22:50:171
1699199903,38cyclictest29866-21grep19:33:220
1699199903,38cyclictest23035-21grep19:13:170
1699199903,38cyclictest23035-21grep19:13:170
1699199903,36cyclictest352-21runrttasks22:41:340
17008998956,28cyclictest0-21swapper/221:17:452
17008998948,31cyclictest0-21swapper/222:28:032
1700899893,75cyclictest0-21swapper/218:58:012
1700099892,9cyclictest0-21swapper/119:27:591
1699199894,39cyclictest3708-21kworker/u17:1+xprtiod21:28:330
16991998932,20cyclictest29580-21kworker/u17:2+nfsiod22:11:260
17008998848,34cyclictest24120-21diskmemload22:46:412
17008998848,34cyclictest24120-21diskmemload22:46:412
17008998848,33cyclictest0-21swapper/223:48:162
17008998845,36cyclictest0-21swapper/223:17:452
17008998845,36cyclictest0-21swapper/223:17:452
17008998842,39cyclictest0-21swapper/220:12:472
17008998842,39cyclictest0-21swapper/220:12:472
17008998737,44cyclictest0-21swapper/200:13:112
17008998731,49cyclictest0-21swapper/222:08:592
17000998745,34cyclictest0-21swapper/119:57:451
1700099873,40cyclictest12138-21timerwakeupswit23:18:211
1700099872,33cyclictest6739-21ssh00:03:221
16991998770,10cyclictest25165-21sshd22:47:170
16991998770,10cyclictest25165-21sshd22:47:170
191892860,10sleep10-21swapper/121:43:081
191892860,10sleep10-21swapper/121:43:081
17008998639,36cyclictest0-21swapper/223:22:552
17000998642,36cyclictest0-21swapper/119:12:461
17000998642,36cyclictest0-21swapper/119:12:461
1700099863,37cyclictest2149-21ssh22:08:151
1700099863,30cyclictest29117-21/usr/sbin/munin23:48:251
77842850,7sleep10-21swapper/121:23:221
17008998528,34cyclictest0-21swapper/220:03:112
17000998542,36cyclictest0-21swapper/122:43:211
17000998542,36cyclictest0-21swapper/122:43:211
17000998541,37cyclictest0-21swapper/120:58:281
17000998539,39cyclictest0-21swapper/122:18:001
17000998533,13cyclictest181rcu_preempt23:47:471
1701599842,45cyclictest22012-21chrt21:48:003
17008998444,33cyclictest24120-21diskmemload22:51:332
17008998443,35cyclictest2797-21cstates23:58:022
17008998443,34cyclictest0-21swapper/221:28:132
1700899842,70cyclictest0-21swapper/222:33:002
1700099842,38cyclictest17635-21ssh22:33:211
17008998345,30cyclictest0-21swapper/219:08:022
17008998345,30cyclictest0-21swapper/219:08:022
17000998339,39cyclictest0-21swapper/123:12:471
1700099833,6cyclictest0-21swapper/123:52:581
1700099833,6cyclictest0-21swapper/123:52:581
1700099833,36cyclictest15696-21grep00:18:201
1700099833,36cyclictest15696-21grep00:18:201
1700099833,34cyclictest10808-21ssh23:17:381
1700099833,34cyclictest10808-21ssh23:17:381
1700099833,33cyclictest26586-21unixbench_multi19:23:211
1700099833,30cyclictest30803-21ls19:38:081
1683728310,45sleep016865-21munin-run18:57:460
17008998244,30cyclictest0-21swapper/219:38:172
17008998241,32cyclictest0-21swapper/221:38:112
17008998240,37cyclictest0-21swapper/200:22:462
17008998240,37cyclictest0-21swapper/200:22:462
1700899822,70cyclictest0-21swapper/219:12:572
1700899822,70cyclictest0-21swapper/219:12:572
1700099823,37cyclictest20412-21ssh00:27:451
1700099823,33cyclictest20285-21/usr/sbin/munin22:38:131
1700099823,33cyclictest10872-21/usr/sbin/munin21:28:211
1700099823,30cyclictest18427-21/usr/sbin/munin20:38:211
1700099822,55cyclictest19510-21apt-get20:43:091
1700099822,55cyclictest19510-21apt-get20:43:091
1700099822,37cyclictest1590-21/usr/sbin/munin21:13:151
16991998262,14cyclictest8389-21kernelversion22:18:520
17008998140,30cyclictest4817-21switchtime21:18:192
17008998140,30cyclictest4817-21switchtime21:18:192
17008998135,36cyclictest0-21swapper/221:48:132
17008998133,37cyclictest0-21swapper/220:48:072
1700099814,37cyclictest2913-21apt-key19:52:491
1700099813,35cyclictest29775-21ssh22:53:241
1700099813,31cyclictest352-21runrttasks19:17:551
1700099812,30cyclictest4705-21sh22:13:041
1700899803,65cyclictest0-21swapper/200:03:012
17000998057,17cyclictest18514-21latency_hist19:02:471
17000998039,33cyclictest0-21swapper/121:38:091
1700099803,38cyclictest20765-21/usr/sbin/munin23:33:141
1700099803,37cyclictest23790-21sh19:17:451
1700099803,37cyclictest23790-21sh19:17:451
1700099803,34cyclictest28582-21sh21:58:141
1700099803,33cyclictest19301-21/usr/sbin/munin19:03:051
1700099803,33cyclictest19301-21/usr/sbin/munin19:03:051
1700099803,32cyclictest15694-21systemd-run21:37:451
1700099803,31cyclictest8644-21/usr/sbin/munin00:08:131
17000998028,44cyclictest0-21swapper/119:33:011
1700099802,35cyclictest13087-21taskset00:14:191
1700899794,61cyclictest4518-21apt-get22:12:572
17008997936,35cyclictest0-21swapper/220:28:152
17008997935,36cyclictest0-21swapper/219:23:072
17008997935,33cyclictest0-21swapper/223:18:002
1700099793,7cyclictest0-21swapper/120:32:571
17000997935,33cyclictest0-21swapper/119:43:141
17000997935,33cyclictest0-21swapper/119:43:141
1700099793,39cyclictest25820-21munin-run23:42:451
1700099793,39cyclictest25820-21munin-run23:42:451
1700099793,37cyclictest1988-21date23:02:481
1700099793,37cyclictest1988-21date23:02:481
1700099793,35cyclictest12161-21grep20:18:211
1700099793,33cyclictest31088-21/usr/sbin/munin21:08:161
1700099793,33cyclictest31088-21/usr/sbin/munin21:08:161
1700099793,32cyclictest23032-21/usr/sbin/munin21:48:211
1700099793,31cyclictest6558-21cut20:03:061
1700099793,31cyclictest4886-21idleruntime-cro23:07:451
1700099793,31cyclictest4886-21idleruntime-cro23:07:451
17008997861,11cyclictest17668-21latency23:28:112
17008997837,34cyclictest0-21swapper/222:23:012
1700899781,45cyclictest17875-21ssh00:23:002
1700099783,39cyclictest352-21runrttasks20:07:571
1700099783,39cyclictest352-21runrttasks20:07:571
1700099783,36cyclictest9758-21/usr/sbin/munin20:13:051
1700099783,33cyclictest14035-21/usr/sbin/munin22:28:091
1700099782,8cyclictest0-21swapper/123:58:001
1700099782,7cyclictest0-21swapper/120:47:561
1700099782,33cyclictest6092-21latency_hist20:02:491
1700099782,33cyclictest15409-21head20:28:251
1700099782,29cyclictest17012-21latency_hist18:57:501
1700899779,56cyclictest3142-21apt-get19:53:082
17008997756,14cyclictest0-21swapper/221:08:212
17008997756,14cyclictest0-21swapper/221:08:212
17008997738,33cyclictest24120-21diskmemload23:08:322
17008997737,33cyclictest0-21swapper/220:58:052
17008997736,32cyclictest0-21swapper/223:03:072
17008997736,32cyclictest0-21swapper/223:03:072
17008997733,37cyclictest0-21swapper/221:43:092
17008997733,37cyclictest0-21swapper/221:43:092
1700099773,32cyclictest27617-21ssh21:03:041
1700099773,31cyclictest12800-21/usr/sbin/munin20:22:551
1700099773,30cyclictest17256-21/usr/sbin/munin23:28:011
1700099773,28cyclictest14137-21/usr/sbin/munin23:23:121
17000997722,43cyclictest0-21swapper/121:53:031
17000997722,43cyclictest0-21swapper/121:53:031
16991997763,10cyclictest16979-21cyclictest00:06:200
16991997760,10cyclictest7613-21kworker/u18:0-writeback00:17:470
1700899764,64cyclictest0-21swapper/221:57:572
1700899763,67cyclictest0-21swapper/223:32:582
1700899763,64cyclictest0-21swapper/219:57:572
1700899762,68cyclictest0-21swapper/220:37:572
17008997538,30cyclictest0-21swapper/221:03:222
1700899753,66cyclictest0-21swapper/221:32:562
17008997535,32cyclictest0-21swapper/221:27:472
1700899753,34cyclictest17527-21latency_hist20:37:482
1701599742,38cyclictest4407-21chrt22:12:483
17008997456,12cyclictest3708-21kworker/u17:1-ext4-rsv-conversion22:42:442
17008997455,11cyclictest0-21swapper/223:42:482
17008997455,11cyclictest0-21swapper/223:42:482
1700899743,66cyclictest0-21swapper/221:52:572
1700899743,66cyclictest0-21swapper/221:52:572
1700899743,61cyclictest0-21swapper/200:07:562
17008997433,36cyclictest0-21swapper/219:02:562
17008997433,36cyclictest0-21swapper/219:02:562
17008997433,33cyclictest0-21swapper/223:47:482
1700899733,62cyclictest0-21swapper/220:17:562
17008997333,33cyclictest0-21swapper/220:23:072
17008997330,35cyclictest0-21swapper/222:53:502
1700899732,53cyclictest24381-21/usr/sbin/munin19:18:082
16991997355,12cyclictest19354-21ssh21:43:100
16991997355,12cyclictest19354-21ssh21:43:100
16991997346,21cyclictest3708-21kworker/u17:1+nfsiod21:54:040
16991997346,21cyclictest3708-21kworker/u17:1+nfsiod21:54:040
16991997340,26cyclictest0-21swapper/023:53:090
16991997340,26cyclictest0-21swapper/023:53:090
1699199733,36cyclictest22068-21cpuspeed21:48:010
1701599723,55cyclictest13794-21taskset00:16:183
17008997229,35cyclictest0-21swapper/220:13:092
16991997246,13cyclictest181rcu_preempt20:02:560
1699199723,37cyclictest4496-21/usr/sbin/munin22:13:230
1701599713,55cyclictest28832-21taskset23:47:453
1701599712,34cyclictest23169-21taskset23:38:003
1701599712,34cyclictest23169-21taskset23:38:003
1700899713,61cyclictest0-21swapper/220:52:592
1700899713,57cyclictest1039-21lockfile-create19:47:462
1700899713,57cyclictest1039-21lockfile-create19:47:462
17008997129,32cyclictest0-21swapper/219:37:492
1701599702,53cyclictest4358-21chrt00:00:013
16991997038,23cyclictest31841-21modprobe19:42:450
1701599698,35cyclictest0-21swapper/322:18:183
1701599693,53cyclictest20871-21chrt20:47:463
1701599693,53cyclictest20871-21chrt20:47:463
1701599693,36cyclictest21487-21taskset22:40:213
1701599693,35cyclictest16723-21chrt22:32:593
1701599693,34cyclictest19162-21taskset00:24:173
1701599692,35cyclictest23749-21taskset22:43:213
1701599692,35cyclictest23749-21taskset22:43:213
1701599692,35cyclictest15725-21chrt00:18:213
1701599692,35cyclictest15725-21chrt00:18:213
17008996949,15cyclictest31682-21cpu22:58:012
17008996949,15cyclictest31682-21cpu22:58:012
16991996931,28cyclictest22186-21apt19:12:450
16991996931,28cyclictest22186-21apt19:12:450
1701599682,52cyclictest10923-21taskset20:17:403
1701599682,35cyclictest19361-21chrt19:03:073
1701599682,35cyclictest19361-21chrt19:03:073
1701599682,35cyclictest17990-21chrt20:38:103
17008996828,35cyclictest0-21swapper/222:03:012
17008996828,35cyclictest0-21swapper/222:03:012
16991996853,9cyclictest4611-21ssh21:18:150
16991996853,9cyclictest4611-21ssh21:18:150
1701599672,34cyclictest31621-21chrt19:40:013
1701599672,31cyclictest25980-21chrt20:59:373
1699199673,52cyclictest8644-21/usr/sbin/munin00:08:020
1701599664,32cyclictest25207-21chrt19:20:253
1701599663,50cyclictest28712-21chrt22:53:013
1701599662,34cyclictest12413-21chrt20:21:083
1701599662,33cyclictest934-21chrt23:00:113
1701599662,33cyclictest934-21chrt23:00:113
1699199663,52cyclictest20861-21munin-run20:47:460
1699199663,52cyclictest20861-21munin-run20:47:460
1699199663,34cyclictest9830-21fschecks_time20:13:070
1701599652,34cyclictest30446-21taskset23:48:543
1701599652,33cyclictest12442-21chrt21:32:073
1701599652,32cyclictest15433-21chrt20:28:253
1699199654,44cyclictest9331-21modprobe20:12:450
1699199654,44cyclictest9331-21modprobe20:12:450
1701599643,32cyclictest8265-21chrt21:23:533
1701599643,32cyclictest741-21chrt19:44:393
1701599643,32cyclictest741-21chrt19:44:393
1701599643,32cyclictest6329-21taskset23:08:263
1701599643,32cyclictest16606-21chrt23:27:103
1701599643,29cyclictest3146-21chrt19:52:573
1701599643,29cyclictest29517-21chrt21:59:353
1701599642,48cyclictest7354-21chrt20:03:263
1701599642,33cyclictest6111-21chrt21:21:133
1701599642,33cyclictest6111-21chrt21:21:133
1701599642,31cyclictest23298-21chrt20:53:173
1701599642,30cyclictest21924-21chrt19:09:313
1701599642,30cyclictest21924-21chrt19:09:313
1701599642,29cyclictest30078-21chrt19:35:483
1699199643,35cyclictest11626-21wc20:18:100
1699199643,32cyclictest22793-21chrt20:53:010
1701599633,31cyclictest19114-21chrt23:30:433
1701599633,31cyclictest12961-21chrt23:20:173
1701599633,30cyclictest32643-21chrt22:04:583
1701599633,30cyclictest32643-21chrt22:04:583
1701599633,28cyclictest27761-21chrt22:51:073
1701599632,32cyclictest30787-21taskset21:08:083
1701599632,32cyclictest30787-21taskset21:08:083
1701599632,31cyclictest8583-21taskset23:13:083
1701599632,31cyclictest8583-21taskset23:13:083
1701599632,31cyclictest16497-21chrt20:33:113
1701599632,30cyclictest22755-21chrt23:37:353
1701599632,29cyclictest27641-21chrt19:28:103
1701599623,29cyclictest11088-21chrt00:12:053
1701599623,26cyclictest986-21chrt23:53:573
1701599623,26cyclictest986-21chrt23:53:573
1701599623,26cyclictest3750-21chrt23:04:413
1701599623,26cyclictest3750-21chrt23:04:413
1701599622,48cyclictest14494-21taskset21:34:303
1701599622,32cyclictest8330-21taskset20:08:083
1701599622,32cyclictest8330-21taskset20:08:083
1701599622,29cyclictest23815-21chrt19:17:453
1701599622,29cyclictest23815-21chrt19:17:453
1701599622,29cyclictest12960-21chrt20:23:033
1701599622,26cyclictest12133-21chrt22:24:163
16991996236,19cyclictest352-21runrttasks19:02:470
1701599613,28cyclictest7875-21chrt00:06:293
1701599613,27cyclictest27992-21chrt21:03:133
1701599613,27cyclictest15661-21chrt22:30:443
1701599613,23cyclictest4712-21chrt22:13:053
1701599612,48cyclictest3894-21chrt21:17:493
1701599612,29cyclictest25956-21chrt19:23:083
1701599612,29cyclictest19607-21chrt21:43:183
1701599612,29cyclictest19607-21chrt21:43:183
1699199613,43cyclictest24318-21cut19:18:070
1699199603,40cyclictest32093-21/usr/sbin/munin19:43:130
1699199603,40cyclictest32093-21/usr/sbin/munin19:43:130
1701599592,32cyclictest17289-21taskset21:38:563
1701599592,28cyclictest26441-21chrt21:54:203
1701599592,28cyclictest26441-21chrt21:54:203
1701599592,28cyclictest18318-21chrt19:00:233
1701599592,27cyclictest5996-21chrt20:01:403
1701599592,27cyclictest2501-21chrt19:51:073
1701599583,26cyclictest22236-21chrt20:49:323
1566624810,23sleep30-21swapper/318:53:083
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional