You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-17 - 21:47
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot7.osadl.org (updated Mon Aug 17, 2026 12:44:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
27061212912,79sleep027030-21apt-get07:05:210
28355210613,63sleep128380-21munin-plugin-st07:09:511
284989910547,15cyclictest28485-21cyclictest07:45:131
27909210011,55sleep227996-21unixbench_multi07:06:092
28498999957,11cyclictest28485-21cyclictest08:04:521
28498999957,11cyclictest28485-21cyclictest08:04:521
70872920,7sleep30-21swapper/307:40:263
70872920,7sleep30-21swapper/307:40:263
28501999158,10cyclictest0-21swapper/209:09:582
28498999064,19cyclictest28765-21timerwakeupswit09:50:251
2849899862,61cyclictest16274-21ssh11:14:571
2849499865,51cyclictest15-21ksoftirqd/007:25:090
28494998649,24cyclictest26812-21kworker/u17:1+flush-179:009:10:060
2850199842,58cyclictest24767-21apt-get12:20:062
28501998368,9cyclictest6394-21systemctl10:59:492
28501998344,8cyclictest181rcu_preempt11:20:232
28494998347,10cyclictest59-21kcompactd011:28:130
28501998254,8cyclictest181rcu_preempt08:10:072
28498998261,15cyclictest21136-21fschecks_time08:25:131
28498998261,15cyclictest21136-21fschecks_time08:25:131
28494998267,9cyclictest28536-21kworker/u17:311:34:500
28494998267,9cyclictest28536-21kworker/u17:311:34:500
2849499826,35cyclictest15-21ksoftirqd/007:30:080
2849499823,45cyclictest15-21ksoftirqd/009:27:010
28494998231,20cyclictest181rcu_preempt12:35:200
28494998220,32cyclictest15-21ksoftirqd/010:45:130
28501998166,10cyclictest28485-21cyclictest10:40:262
28501998163,14cyclictest28485-21cyclictest12:35:132
2849899813,59cyclictest24807-21sh12:20:051
28494998113,38cyclictest15-21ksoftirqd/009:42:480
28494998113,38cyclictest15-21ksoftirqd/009:42:480
28501997960,13cyclictest23244-21latency_hist10:34:522
28498997962,11cyclictest296-21systemd-logind10:34:511
28501997836,10cyclictest181rcu_preempt10:45:552
28494997848,23cyclictest161ktimers/009:35:140
28494997811,42cyclictest15-21ksoftirqd/008:40:080
28501997762,9cyclictest3243-21ntp_kernel_err11:45:202
28501997760,10cyclictest11542-21ssh11:59:272
28501997760,10cyclictest11542-21ssh11:59:272
28501997756,11cyclictest0-21swapper/212:04:522
28501997728,9cyclictest371rcuc/209:05:042
28498997762,9cyclictest11868-21modprobe09:24:501
2849899772,36cyclictest204-21systemd-journal09:38:001
2849499773,46cyclictest15-21ksoftirqd/010:23:340
2849499773,46cyclictest15-21ksoftirqd/010:23:340
28494997732,21cyclictest15-21ksoftirqd/008:49:540
28494997732,19cyclictest181rcu_preempt11:50:150
28501997658,13cyclictest11334-21sh09:23:272
28501997658,12cyclictest1306-21latency_hist09:04:532
28501997654,15cyclictest3051-21latency_hist07:29:542
28501997648,8cyclictest181rcu_preempt08:45:272
28501997646,13cyclictest181rcu_preempt10:06:072
28501997640,8cyclictest181rcu_preempt12:08:532
28498997656,10cyclictest0-21swapper/110:20:131
28498997656,10cyclictest0-21swapper/110:20:131
2849899762,38cyclictest61361ssh09:15:101
2849499762,32cyclictest15-21ksoftirqd/011:05:230
2725527616,33sleep30-21swapper/307:05:493
28501997559,10cyclictest353-21runrttasks11:18:522
28501997555,14cyclictest4580-21latency_hist07:34:532
28501997554,9cyclictest181rcu_preempt09:53:572
28501997544,8cyclictest181rcu_preempt09:19:142
28498997533,33cyclictest19130-21switchtime12:10:251
28494997557,12cyclictest204-21systemd-journal08:00:280
28494997557,12cyclictest204-21systemd-journal08:00:280
28494997544,10cyclictest59-21kcompactd007:39:000
28494997524,22cyclictest15-21ksoftirqd/011:58:450
28494997524,22cyclictest15-21ksoftirqd/011:58:450
2849499752,39cyclictest15-21ksoftirqd/012:10:210
28501997455,13cyclictest21067-21latency_hist12:14:522
28501997452,13cyclictest371rcuc/208:40:062
28501997451,17cyclictest21688-21cpu09:40:102
28501997451,17cyclictest21688-21cpu09:40:102
28501997447,7cyclictest181rcu_preempt09:35:012
28501997444,20cyclictest30715-21/usr/sbin/munin07:15:202
28501997430,9cyclictest181rcu_preempt08:29:492
28501997430,9cyclictest181rcu_preempt08:29:492
28501997422,24cyclictest0-21swapper/208:00:022
28501997422,24cyclictest0-21swapper/208:00:022
2849899742,39cyclictest13584-21ntp_offset11:10:201
2849899742,39cyclictest13584-21ntp_offset11:10:201
2849499742,29cyclictest15-21ksoftirqd/012:21:380
28501997358,8cyclictest0-21swapper/212:19:532
28501997352,8cyclictest181rcu_preempt10:03:482
28501997352,8cyclictest181rcu_preempt10:03:482
28501997317,36cyclictest22613-21sort11:25:012
28498997356,11cyclictest5186-21ssh10:56:451
2849899733,42cyclictest3303-21apt-get09:10:051
28494997359,10cyclictest28485-21cyclictest11:02:450
28494997358,10cyclictest28485-21cyclictest10:56:150
2849499734,37cyclictest15-21ksoftirqd/009:50:110
28494997335,10cyclictest59-21kcompactd010:10:540
2849499733,38cyclictest15-21ksoftirqd/009:46:080
28501997257,9cyclictest0-21swapper/210:20:232
28501997257,9cyclictest0-21swapper/210:20:232
28501997249,15cyclictest204-21systemd-journal12:26:572
28498997254,13cyclictest2229-21threads12:35:251
28498997228,8cyclictest181rcu_preempt07:55:251
2849899722,38cyclictest15777-21kernelversion09:30:161
28494997256,9cyclictest0-21swapper/011:10:250
28494997256,9cyclictest0-21swapper/011:10:250
28494997256,11cyclictest5754-21kworker/u18:1+flush-179:011:15:090
28494997253,13cyclictest11873-21latency_hist09:24:530
28494997250,15cyclictest4583-21sh10:04:530
28494997250,15cyclictest4583-21sh10:04:530
28494997249,16cyclictest22335-21sh11:24:510
28494997240,24cyclictest32638-21cat09:00:150
28494997239,8cyclictest0-21swapper/009:57:420
28494997234,17cyclictest0-21swapper/007:40:190
28494997234,17cyclictest0-21swapper/007:40:190
2849499722,37cyclictest15-21ksoftirqd/009:05:070
28501997156,9cyclictest0-21swapper/209:25:142
28501997152,14cyclictest20711-21latency_hist08:24:532
28501997148,17cyclictest296-21systemd-logind11:39:502
28498997151,14cyclictest27498-21idleruntime-cro09:49:491
28498997148,15cyclictest28485-21cyclictest07:10:281
28498997143,20cyclictest1166-21sh10:50:261
28498997143,20cyclictest1166-21sh10:50:261
28498997143,12cyclictest31682-21kworker/u18:0+rpciod09:27:081
28498997137,9cyclictest181rcu_preempt07:20:191
2849899713,46cyclictest8573-21modprobe11:54:501
2849899712,33cyclictest22578-21sh09:40:311
2849899712,33cyclictest22578-21sh09:40:311
28498997112,19cyclictest31-21ksoftirqd/111:44:251
28498997112,19cyclictest31-21ksoftirqd/111:44:251
28494997154,11cyclictest22001-21runrttasks12:15:190
28494997147,19cyclictest28485-21cyclictest10:50:050
28494997147,19cyclictest28485-21cyclictest10:50:050
28494997143,20cyclictest3921-21kworker/u17:3+nfsiod12:08:180
2849499712,59cyclictest15-21ksoftirqd/008:50:070
2849499712,43cyclictest15-21ksoftirqd/010:08:250
28501997055,10cyclictest852-21ssh09:58:432
28501997055,10cyclictest28485-21cyclictest08:15:192
2850199705,26cyclictest9591-21apt-get07:50:032
28501997052,11cyclictest28485-21cyclictest08:05:262
28501997052,11cyclictest28485-21cyclictest08:05:262
28501997049,15cyclictest2734-21diskmemload11:10:292
28501997049,15cyclictest2734-21diskmemload11:10:292
28501997048,15cyclictest28485-21cyclictest11:42:112
28501997048,15cyclictest28485-21cyclictest11:42:112
28501997030,26cyclictest287-21dbus-daemon10:29:522
28498997054,10cyclictest16382-21kworker/u19:3-rpciod11:33:281
28498997054,10cyclictest16382-21kworker/u19:3-rpciod11:33:281
28498997040,10cyclictest181rcu_preempt11:45:101
2849899703,41cyclictest28178-21timerandwakeup08:45:271
2849899703,40cyclictest24392-21apt-key12:19:521
28498997031,10cyclictest181rcu_preempt11:35:281
28498997027,12cyclictest181rcu_preempt10:49:401
2849899702,40cyclictest31945-21munin-run08:59:511
2849899702,40cyclictest31945-21munin-run08:59:511
28498997023,11cyclictest28485-21cyclictest09:56:531
2849899702,25cyclictest5350-21ps07:35:231
28498997021,27cyclictest353-21runrttasks12:05:181
28494997054,8cyclictest0-21swapper/008:14:500
28494997054,11cyclictest26385-21systemd-run10:39:500
28494997049,15cyclictest17546-21fschecks_time10:25:120
28494997043,19cyclictest9085-21kworker/u17:1+nfsiod12:31:240
28494997018,26cyclictest15-21ksoftirqd/008:06:230
28494997018,26cyclictest15-21ksoftirqd/008:06:230
28501996952,12cyclictest11604-21sh11:07:092
28501996950,14cyclictest11060-21sh10:15:072
28498996954,9cyclictest19029-21awk08:19:501
28498996954,11cyclictest28485-21cyclictest10:15:181
28498996953,11cyclictest353-21runrttasks10:25:111
28498996951,11cyclictest299-21rs:main1
28498996945,14cyclictest25284-21kworker/u17:2-xprtiod12:01:351
2849899693,37cyclictest30322-21latency_hist08:54:531
2849899692,34cyclictest2734-21diskmemload12:25:131
2849899692,33cyclictest2921-21dpkg09:09:531
28494996955,8cyclictest3921-21kworker/u17:3+xprtiod12:00:130
28494996941,20cyclictest29568-21kworker/u17:3+nfsiod10:30:440
28494996934,11cyclictest181rcu_preempt12:28:090
28501996839,9cyclictest181rcu_preempt11:54:022
28501996829,26cyclictest7515-21cut11:00:242
28498996850,12cyclictest29488-21latency_hist10:44:521
2849899682,33cyclictest2976-21sshd10:01:001
2849899682,33cyclictest2976-21sshd10:01:001
28494996853,9cyclictest28485-21cyclictest08:31:070
28494996850,12cyclictest1-21systemd11:40:010
28494996850,12cyclictest1-21systemd11:40:010
28494996838,10cyclictest181rcu_preempt07:50:250
28494996830,7cyclictest181rcu_preempt07:55:150
28501996753,10cyclictest28485-21cyclictest07:24:532
28501996748,14cyclictest1004-21kworker/u17:3+events_unbound07:39:512
28501996744,8cyclictest181rcu_preempt12:31:482
28501996740,9cyclictest181rcu_preempt10:35:132
2850199672,32cyclictest39-21ksoftirqd/210:10:082
28498996734,24cyclictest0-21swapper/108:09:531
28498996734,24cyclictest0-21swapper/108:09:531
2849899672,38cyclictest23859-21ls08:34:501
28494996751,10cyclictest30848-21fschecks_time08:55:120
28494996751,10cyclictest30848-21fschecks_time08:55:120
28494996737,9cyclictest181rcu_preempt10:15:250
2849499673,36cyclictest6815-21timerandwakeup09:15:270
2849499673,35cyclictest28674-21/usr/sbin/munin07:10:170
2849499673,34cyclictest24106-21/usr/sbin/munin08:35:120
2849499673,34cyclictest24106-21/usr/sbin/munin08:35:120
2849499672,41cyclictest353-21runrttasks08:16:310
2849499672,41cyclictest15-21ksoftirqd/007:22:160
28494996711,40cyclictest20900-21sort08:25:020
28494996711,40cyclictest20900-21sort08:25:020
28501996652,7cyclictest0-21swapper/209:48:582
28501996651,10cyclictest28485-21cyclictest11:30:142
28501996651,10cyclictest28485-21cyclictest11:30:142
28498996647,13cyclictest9085-21kworker/u17:1-xprtiod11:55:261
28498996647,13cyclictest9085-21kworker/u17:1-xprtiod11:55:261
28498996642,9cyclictest181rcu_preempt07:15:101
28498996642,12cyclictest32157-21kworker/u18:0+rpciod10:10:561
28498996641,7cyclictest181rcu_preempt09:04:351
28498996641,12cyclictest181rcu_preempt12:30:111
28498996636,10cyclictest181rcu_preempt10:05:561
28498996635,10cyclictest181rcu_preempt11:05:231
28498996624,13cyclictest181rcu_preempt08:40:261
2849899662,33cyclictest3421-21idleruntime07:30:131
28494996653,9cyclictest26812-21kworker/u17:1+rpciod09:30:270
28494996636,22cyclictest27244-21nfs4_client10:40:200
2849499663,36cyclictest353-21runrttasks07:45:410
2849499663,24cyclictest29802-21ssh11:35:260
2850199657,25cyclictest16622-21ssh09:30:572
28501996544,8cyclictest181rcu_preempt07:45:132
28498996547,13cyclictest22347-21sh11:24:521
28498996547,12cyclictest30284-21munin-node07:50:081
2849899652,45cyclictest24701-21grep08:35:231
2849899652,45cyclictest24701-21grep08:35:231
2849499652,26cyclictest15-21ksoftirqd/011:45:270
28501996446,9cyclictest0-21swapper/210:50:192
28501996446,9cyclictest0-21swapper/210:50:192
28501996445,11cyclictest296-21systemd-logind08:54:512
2850199643,28cyclictest11436-21fschecks_time07:55:122
28498996424,7cyclictest181rcu_preempt10:35:081
28498996421,33cyclictest7628-21timerandwakeup11:00:261
2849499643,27cyclictest15-21ksoftirqd/007:15:040
28494996414,32cyclictest15-21ksoftirqd/008:20:130
28501996351,8cyclictest59-21kcompactd008:55:142
28501996351,8cyclictest59-21kcompactd008:55:142
28501996347,10cyclictest6873-21ntp_kernel_pll_07:40:202
28501996347,10cyclictest6873-21ntp_kernel_pll_07:40:202
28501996347,10cyclictest29191-21ntpq07:10:192
2849899632,39cyclictest2865-21modprobe07:29:501
28501996245,9cyclictest0-21swapper/208:34:532
28498996212,21cyclictest0-21swapper/107:40:231
28498996212,21cyclictest0-21swapper/107:40:231
28501996012,8cyclictest181rcu_preempt08:39:502
28501996012,8cyclictest181rcu_preempt08:39:502
2849899603,34cyclictest16672-21sendmail_mailqu08:10:231
28498996024,18cyclictest19313-21runrttasks08:20:041
2850599543,36cyclictest25258-21taskset12:21:193
2850599513,35cyclictest30459-21taskset11:36:433
28505995128,16cyclictest242652sleep311:26:513
28505995121,21cyclictest20473-21chrt11:20:263
163452510,9sleep30-21swapper/309:30:283
2850599503,28cyclictest27456-21chrt09:49:453
2850599493,30cyclictest908-21kworker/3:1+events07:20:013
2850599474,31cyclictest15774-21taskset11:14:503
2850599474,31cyclictest15774-21taskset11:14:503
2850599473,29cyclictest29765-21taskset10:44:583
2850599473,26cyclictest17258-21taskset10:25:003
28505994729,12cyclictest220512sleep312:15:233
2850599464,32cyclictest28552-21taskset09:50:223
2850599464,32cyclictest19057-21taskset08:19:503
2850599464,31cyclictest7736-21taskset09:17:143
2850599463,32cyclictest12377-21chrt11:09:103
2850599462,33cyclictest30665-21taskset12:29:543
2850599453,32cyclictest32182-21chrt11:40:083
2850599453,32cyclictest32182-21chrt11:40:083
2850599453,30cyclictest29396-21taskset12:27:103
2850599453,30cyclictest19967-21taskset12:11:583
2850599453,30cyclictest13967-21taskset12:02:333
28505994531,8cyclictest6172sleep310:50:093
28505994531,8cyclictest6172sleep310:50:093
2850599447,27cyclictest2746-21chrt12:36:103
2850599443,32cyclictest6739-21taskset10:07:413
2850599443,31cyclictest6960-21taskset11:50:383
2850599443,31cyclictest32094-21chrt09:55:333
2850599443,29cyclictest30240-21taskset07:14:543
2850599443,28cyclictest2702-21taskset11:45:063
2850599443,28cyclictest16479-21taskset11:15:273
2850599443,26cyclictest22529-21taskset10:33:073
2850599434,29cyclictest21184-21taskset09:39:443
2850599433,31cyclictest32503-21taskset09:00:123
2850599433,31cyclictest11670-21taskset09:24:193
2850599433,30cyclictest31966-21chrt07:18:353
2850599433,28cyclictest3527-21taskset10:54:553
2850599433,28cyclictest25765-21taskset08:40:033
2850599433,28cyclictest22524-21taskset08:30:033
2850599433,28cyclictest16654-21taskset12:06:273
2850599433,28cyclictest1660-21taskset10:00:033
2850599433,28cyclictest1660-21taskset10:00:033
2850599433,28cyclictest11201-21taskset07:55:043
2850599433,27cyclictest3245-21taskset09:09:563
2850599433,27cyclictest28989-21taskset08:50:043
2850599433,27cyclictest12148-21taskset09:24:563
2850599433,27cyclictest11124-21chrt10:15:073
2850599433,26cyclictest14795-21taskset08:05:163
2850599433,26cyclictest14795-21taskset08:05:163
2850599432,28cyclictest28507-21taskset10:42:193
116072432,6sleep30-21swapper/311:59:383
116072432,6sleep30-21swapper/311:59:383
2850599424,26cyclictest7986-21taskset07:45:033
2850599423,29cyclictest30594-21taskset08:55:023
2850599423,29cyclictest30594-21taskset08:55:023
2850599423,29cyclictest26931-21taskset11:30:393
2850599423,29cyclictest26931-21taskset11:30:393
2850599423,29cyclictest23593-21taskset09:42:483
2850599423,29cyclictest23593-21taskset09:42:483
2850599423,27cyclictest7864-21taskset10:10:003
2850599422,30cyclictest15581-21chrt10:21:153
2850599422,30cyclictest15581-21chrt10:21:153
2850599422,29cyclictest27612-21taskset08:45:143
2850599422,28cyclictest23474-21taskset10:34:573
2850599422,28cyclictest19465-21taskset08:20:113
2850599422,27cyclictest1393-21taskset09:05:023
2850599413,29cyclictest8233-21chrt11:01:283
2850599413,28cyclictest21964-21taskset08:26:143
2850599413,28cyclictest21964-21taskset08:26:143
2850599413,28cyclictest10129-21taskset07:50:223
2850599413,27cyclictest24107-21taskset08:35:013
2850599413,27cyclictest24107-21taskset08:35:013
2850599412,30cyclictest13122-21chrt08:00:143
2850599412,30cyclictest13122-21chrt08:00:143
2850599412,28cyclictest3111-21taskset07:29:573
2850599412,28cyclictest2459-21taskset07:25:273
2850599412,28cyclictest16057-21chrt08:10:023
2850599402,29cyclictest5271-21taskset07:35:193
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional