You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-17 - 14:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot7.osadl.org (updated Wed Jun 17, 2026 00:44:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
317439912043,23cyclictest24324-21modprobe20:13:560
317439911439,8cyclictest0-21swapper/021:09:280
30391211217,68sleep030469-21fschecks_time18:54:210
317439911180,25cyclictest16181-21kernelversion21:14:230
3266821100,6sleep20-21swapper/222:34:512
3266821100,6sleep20-21swapper/222:34:512
317439911035,8cyclictest0-21swapper/019:08:550
317439911033,8cyclictest0-21swapper/022:15:120
317439911028,70cyclictest0-21swapper/019:19:170
31743991102,31cyclictest19643-21sendmail23:08:550
31743991102,31cyclictest19643-21sendmail23:08:550
31743991073,32cyclictest13588-21fschecks_time22:04:200
317439910717,32cyclictest10932-21sh19:33:560
317439910551,45cyclictest0-21swapper/023:53:580
317439910534,7cyclictest0-21swapper/000:21:430
317439910534,7cyclictest0-21swapper/000:21:430
31743991053,44cyclictest3099-21expr23:34:130
31743991044,35cyclictest9549-21ntp_states23:44:280
31743991044,35cyclictest9549-21ntp_states23:44:280
2553921040,8sleep20-21swapper/223:18:042
87721030,5sleep30-21swapper/319:03:583
31743991033,38cyclictest30188-21seq22:31:160
31743991033,37cyclictest30263-21/usr/sbin/munin23:24:330
317439910234,8cyclictest0-21swapper/021:24:180
31743991022,38cyclictest5915-21acpi23:39:050
317599910133,28cyclictest4786-21modprobe20:53:552
317439910133,13cyclictest0-21swapper/021:53:580
317439910133,13cyclictest0-21swapper/021:53:580
317439910131,12cyclictest0-21swapper/022:09:040
317439910034,8cyclictest0-21swapper/022:03:550
317439910033,8cyclictest0-21swapper/019:59:330
317439910033,11cyclictest0-21swapper/022:59:120
317439910030,10cyclictest0-21swapper/023:09:550
317439910026,11cyclictest0-21swapper/000:02:200
31743991002,32cyclictest4912-21rm22:43:590
3174399993,33cyclictest21614-21find00:04:290
3174399993,33cyclictest21614-21find00:04:290
31743999931,15cyclictest0-21swapper/019:49:310
31743999925,15cyclictest0-21swapper/020:44:330
31743999925,15cyclictest0-21swapper/020:44:330
3174399992,34cyclictest638-21ssh23:30:160
3174399992,34cyclictest638-21ssh23:30:160
31743999835,8cyclictest0-21swapper/023:19:310
31759999740,30cyclictest0-21swapper/221:48:582
31743999728,15cyclictest31731-21cyclictest21:08:580
31743999726,22cyclictest24240-21kworker/u17:2+nfsiod21:20:580
3174399972,33cyclictest3707-21fschecks_time20:49:160
3174399972,33cyclictest27058-21grep20:19:320
3174399972,33cyclictest27058-21grep20:19:320
3174399972,23cyclictest12697-21ssh22:56:160
31743999722,21cyclictest4697-21ssh22:43:570
31743999718,22cyclictest29803-21cut00:18:590
31759999637,49cyclictest0-21swapper/222:39:252
3174399963,43cyclictest17883-21/usr/sbin/munin19:54:220
3174399963,36cyclictest352-21runrttasks00:10:180
3174399963,34cyclictest6613-21latency_hist20:58:590
3174399963,34cyclictest6613-21latency_hist20:58:590
3174399963,33cyclictest3935-21ls19:09:290
31743999632,7cyclictest0-21swapper/019:14:220
31759999542,45cyclictest0-21swapper/220:43:592
31759999517,58cyclictest32498-21sh23:29:182
31759999517,58cyclictest32498-21sh23:29:182
3174399953,34cyclictest8384-21head21:54:360
3174399953,34cyclictest22475-21apt-get20:09:000
3174399952,35cyclictest13933-21grep19:39:310
3174399952,35cyclictest13933-21grep19:39:310
31759999445,41cyclictest0-21swapper/223:43:582
3174399944,28cyclictest25980-21memory22:24:240
3174399943,34cyclictest32643-21/usr/sbin/munin20:39:170
3174399943,33cyclictest27699-21acpi21:34:060
3174399943,32cyclictest8546-21/usr/sbin/munin22:49:250
3174399943,32cyclictest25144-21latency_hist22:23:580
3174399943,32cyclictest25144-21latency_hist22:23:580
3174399943,31cyclictest7938-21/usr/sbin/munin19:24:230
3174399943,23cyclictest15818-21timerandwakeup23:54:350
3174399943,23cyclictest15818-21timerandwakeup23:54:350
3174399942,22cyclictest31879-21timerwakeupswit20:34:340
31743999411,33cyclictest362-21grep18:59:330
3037329425,40sleep30-21swapper/318:54:203
112342940,8sleep30-21swapper/321:05:433
31759999339,46cyclictest0-21swapper/222:54:342
3174399933,34cyclictest25107-21if_eth021:29:190
31743999330,13cyclictest0-21swapper/023:14:330
31759999242,43cyclictest0-21swapper/220:29:342
31759999242,42cyclictest0-21swapper/220:58:592
31759999242,42cyclictest0-21swapper/220:58:592
31759999237,48cyclictest31731-21cyclictest19:43:582
31759999237,48cyclictest31731-21cyclictest19:43:582
31759999233,8cyclictest0-21swapper/220:28:562
31759999228,11cyclictest0-21swapper/200:14:062
31759999226,25cyclictest32382-21cron20:38:552
3174399923,31cyclictest352-21runrttasks21:46:170
31759999140,44cyclictest0-21swapper/221:38:402
31759999136,48cyclictest0-21swapper/223:59:322
31759999136,48cyclictest0-21swapper/223:49:322
31759999135,49cyclictest0-21swapper/221:28:582
31759999132,8cyclictest0-21swapper/222:33:562
31743999171,12cyclictest0-21swapper/000:28:540
31759999042,41cyclictest0-21swapper/220:14:282
31759999034,50cyclictest0-21swapper/221:15:472
31759999033,8cyclictest0-21swapper/223:04:322
31759999033,8cyclictest0-21swapper/223:04:322
31743999026,10cyclictest0-21swapper/019:44:470
3174399902,37cyclictest24580-21/usr/sbin/munin20:14:280
31759998944,38cyclictest0-21swapper/221:04:252
31759998935,46cyclictest0-21swapper/200:04:332
31759998935,46cyclictest0-21swapper/200:04:332
31759998933,8cyclictest0-21swapper/222:44:302
3175999892,40cyclictest6879-21ntpq19:19:252
3174399893,33cyclictest27793-21/usr/sbin/munin20:24:340
3174399892,33cyclictest352-21runrttasks20:29:410
307572898,55sleep130770-21open_files18:54:351
31759998841,40cyclictest0-21swapper/221:54:222
31759998833,7cyclictest0-21swapper/222:15:042
3175999883,28cyclictest22724-21latency_hist20:08:582
3175999882,41cyclictest31425-21sendmail_mailst21:39:292
3175999882,41cyclictest31425-21sendmail_mailst21:39:292
3175999882,34cyclictest3753-21sendmail_mailqu19:09:262
31754998871,11cyclictest12502-21ssh21:08:581
3174399882,31cyclictest352-21runrttasks21:01:480
31759998740,40cyclictest0-21swapper/219:14:332
31759998735,8cyclictest0-21swapper/220:59:242
3175999873,34cyclictest14916-21/usr/sbin/munin23:54:262
3175999873,34cyclictest14916-21/usr/sbin/munin23:54:262
3175999873,33cyclictest9106-21ssh22:49:362
31759998733,10cyclictest0-21swapper/219:04:342
3175999873,28cyclictest879-21latency_hist19:03:582
31759998730,8cyclictest0-21swapper/223:13:552
3175999872,36cyclictest24129-21fschecks_count00:09:172
3175999872,33cyclictest17108-21cat19:49:322
3174399872,31cyclictest1622-21ssh22:38:480
3174399872,31cyclictest1622-21ssh22:38:480
31759998638,43cyclictest0-21swapper/221:12:172
31759998634,7cyclictest0-21swapper/223:19:232
3175999863,30cyclictest6990-21awk21:53:562
3175999863,30cyclictest6990-21awk21:53:562
31759998627,12cyclictest0-21swapper/219:35:482
3175999862,34cyclictest14365-21awk22:59:192
31754998665,15cyclictest6383-21cron20:58:551
31754998665,15cyclictest6383-21cron20:58:551
31743998617,24cyclictest30782-21awk21:39:120
31743998617,24cyclictest30782-21awk21:39:120
31759998535,8cyclictest30843-21diskmemload23:26:102
31759998535,8cyclictest2214-21diskmemload00:26:322
3175999853,36cyclictest30119-21fschecks_count00:19:172
3175999853,36cyclictest30119-21fschecks_count00:19:172
3175999853,35cyclictest25929-21ssh22:24:232
3175999853,33cyclictest3263-21latency_hist20:48:582
3175999853,33cyclictest3263-21latency_hist20:48:582
3175999853,31cyclictest12011-21taskset22:01:192
3174399852,24cyclictest12085-21proc_pri19:35:250
3175999843,31cyclictest23716-21find20:10:492
3175999843,30cyclictest27605-21latency_hist21:33:592
3175999842,30cyclictest20020-21ntpq19:59:252
31759998417,17cyclictest0-21swapper/221:23:582
3158228411,44sleep231605-21munin-run18:58:562
3175999833,34cyclictest8229-21fschecks_time19:24:182
3175999833,34cyclictest10929-21apt19:33:562
3175999833,33cyclictest15613-21ssh22:08:032
3175999833,32cyclictest14633-21/usr/sbin/munin19:44:062
3175999833,30cyclictest9232-21fschecks_time23:44:192
3175999833,30cyclictest9232-21fschecks_time23:44:192
31759998330,46cyclictest0-21swapper/220:19:232
31759998330,46cyclictest0-21swapper/220:19:232
3175999832,30cyclictest2928-21/usr/sbin/munin23:34:342
3175999822,35cyclictest19422-21latency_hist19:58:592
3175999813,36cyclictest352-21runrttasks22:11:242
3175999812,32cyclictest23156-21proc_pri22:19:292
3175999812,32cyclictest23156-21proc_pri22:19:292
31754998166,10cyclictest31731-21cyclictest21:39:181
31754998166,10cyclictest31731-21cyclictest21:39:181
31754998161,12cyclictest11645-40mandb23:48:571
31754998161,12cyclictest11645-40mandb23:48:571
31754997861,13cyclictest5715-21kworker/u17:1+events_unbound22:28:551
31754997761,10cyclictest10983-21systemd-run19:33:571
3175499763,46cyclictest31-21ksoftirqd/100:25:311
31754997558,11cyclictest31731-21cyclictest23:19:211
31754997547,21cyclictest5032-21kworker/u18:1+nfsiod22:05:031
31754997456,11cyclictest6407-21diskmemload20:59:171
31754997455,12cyclictest1908-21latency19:04:241
31754997452,15cyclictest23588-21cut00:08:571
31754997452,15cyclictest23588-21cut00:08:571
31754997356,12cyclictest3934-21timerwakeupswit23:34:321
31754997354,13cyclictest16786-21unixbench_singl21:14:341
31754997354,12cyclictest300-21rs:main1
31754997351,16cyclictest20895-21sh21:22:341
31754997342,24cyclictest16713-21kernelversion22:09:211
31754997257,9cyclictest31539-21sh23:28:071
31754997055,7cyclictest0-21swapper/122:14:201
31754997053,10cyclictest17137-21ssh23:04:151
31754997053,10cyclictest17137-21ssh23:04:151
31754997047,17cyclictest22779-21latency_hist20:08:581
31754997046,10cyclictest181rcu_preempt22:52:151
31754997039,22cyclictest3525-21grep19:09:191
31754996951,9cyclictest181rcu_preempt19:49:111
31754996948,15cyclictest4786-21latency_hist22:43:581
31754996853,8cyclictest0-21swapper/122:34:121
31754996853,8cyclictest0-21swapper/122:34:121
31754996853,11cyclictest31731-21cyclictest21:26:081
31754996832,9cyclictest181rcu_preempt21:32:541
31754996830,9cyclictest21158-21ssh23:10:081
31754996822,27cyclictest6879-21timerwakeupswit23:39:311
31754996751,10cyclictest21988-21kworker/u17:2-rpciod22:29:291
31754996750,9cyclictest0-21swapper/100:09:191
31754996748,9cyclictest0-21swapper/119:14:301
3175499673,49cyclictest24238-21grep23:14:331
31754996649,9cyclictest0-21swapper/123:49:191
3175499663,46cyclictest27200-21fschecks_time00:14:181
31754996629,18cyclictest6407-21diskmemload22:19:001
31754996629,18cyclictest6407-21diskmemload22:19:001
3175499662,36cyclictest31240-21grep20:34:171
31754996615,14cyclictest181rcu_preempt19:39:161
31754996615,14cyclictest181rcu_preempt19:39:161
31754996549,8cyclictest0-21swapper/121:54:221
31754996545,12cyclictest2764-21ssh23:33:581
31754996545,12cyclictest2764-21ssh23:33:581
3175499654,37cyclictest352-21runrttasks20:12:241
31754996538,18cyclictest30204-21cut00:19:181
31754996538,18cyclictest30204-21cut00:19:181
3175499653,41cyclictest5565-21ntp_kernel_pll_22:44:251
31754996518,12cyclictest30936-21latency_hist20:33:581
31754996450,10cyclictest31731-21cyclictest19:27:241
31754996449,8cyclictest0-21swapper/100:03:541
31754996449,10cyclictest31731-21cyclictest19:21:081
31754996447,9cyclictest0-21swapper/121:53:551
31754996447,9cyclictest0-21swapper/121:53:551
3175499644,46cyclictest14903-21fschecks_time19:44:181
3175499644,38cyclictest18083-21fschecks_count19:54:191
31754996437,8cyclictest181rcu_preempt19:59:121
3175499643,45cyclictest6407-21diskmemload21:48:591
3175499643,36cyclictest352-21runrttasks20:24:141
31754996429,27cyclictest14813-21switchtime22:59:301
31754996429,23cyclictest15042-21cat23:54:151
31754996429,23cyclictest15042-21cat23:54:151
31754996427,19cyclictest31900-21/usr/sbin/munin18:59:221
3175499633,43cyclictest352-21runrttasks20:39:051
31754996248,10cyclictest31731-21cyclictest20:49:271
31754996246,8cyclictest0-21swapper/120:44:331
31754996246,8cyclictest0-21swapper/120:44:331
31754996238,8cyclictest181rcu_preempt21:59:001
3175499623,43cyclictest28008-21fschecks_time21:34:181
3175499623,37cyclictest25276-21mailstats20:14:291
3175499623,37cyclictest12821-21sort21:09:121
3175499614,34cyclictest11735-21fschecks_time19:35:151
3175499613,43cyclictest352-21runrttasks20:19:481
3175499613,43cyclictest352-21runrttasks20:19:481
31766996011,35cyclictest0-21swapper/322:14:373
3176699593,43cyclictest1700-21taskset23:31:183
3176699593,43cyclictest1700-21taskset23:31:183
3176699582,39cyclictest29159-21taskset22:29:293
3176699562,37cyclictest2215-21taskset22:39:183
3176699553,36cyclictest10288-21chrt21:59:093
3176699543,33cyclictest27812-21chrt20:24:073
3176699542,35cyclictest25179-21chrt23:17:043
3176699533,31cyclictest865-21chrt00:24:203
3176699523,36cyclictest14108-21chrt21:10:183
3176699523,31cyclictest8299-21taskset19:24:203
3176699522,34cyclictest32150-21taskset23:28:593
3176699513,35cyclictest11671-21chrt23:48:583
3176699513,35cyclictest11671-21chrt23:48:583
3176699513,31cyclictest23115-21chrt23:13:593
3176699512,35cyclictest30079-21taskset21:38:063
3176699512,31cyclictest27750-21taskset20:23:583
3176699512,31cyclictest27750-21taskset20:23:583
3176699505,29cyclictest6473-21chrt19:19:133
3176699503,33cyclictest17651-21chrt21:16:503
3176699503,32cyclictest7801-21chrt22:48:583
3176699503,31cyclictest11574-21chrt22:54:263
3176699502,32cyclictest28710-21chrt00:16:343
3176699493,31cyclictest21042-21taskset21:22:583
31766994925,14cyclictest0-21swapper/300:09:333
3176699482,31cyclictest589-21chrt20:39:223
3176699482,30cyclictest17824-21chrt23:58:593
3176699482,30cyclictest17824-21chrt23:58:593
3176699482,28cyclictest7267-21taskset21:54:073
3176699482,28cyclictest19433-21chrt19:58:593
3176699474,30cyclictest2477-21taskset19:04:353
3176699473,33cyclictest16969-21taskset23:04:103
3176699473,33cyclictest16969-21taskset23:04:103
3176699472,32cyclictest4469-21chrt20:49:553
3176699472,31cyclictest32676-21chrt22:34:523
3176699472,31cyclictest32676-21chrt22:34:523
3176699472,31cyclictest31378-21taskset20:34:193
3176699463,31cyclictest13902-21taskset22:04:283
3176699463,30cyclictest6104-21chrt23:39:133
3176699463,30cyclictest17917-21chrt23:59:073
3176699462,31cyclictest3100-21chrt21:46:373
3176699462,31cyclictest15282-21chrt23:00:093
3176699453,30cyclictest8758-21taskset22:49:313
3176699453,30cyclictest21521-21taskset00:04:263
3176699453,30cyclictest21521-21taskset00:04:263
3176699453,29cyclictest16569-21taskset19:49:193
3176699453,29cyclictest0-21swapper/319:34:293
3176699453,28cyclictest21096-21taskset20:04:053
3176699452,30cyclictest3287-21taskset23:34:183
31766994522,12cyclictest0-21swapper/319:09:223
31766994514,20cyclictest25086-21chrt21:29:183
3176699442,30cyclictest2132-21chrt20:44:203
3176699442,30cyclictest2132-21chrt20:44:203
3176699433,31cyclictest31080-21chrt21:39:193
3176699433,31cyclictest31080-21chrt21:39:193
3176699433,31cyclictest28196-21chrt22:28:563
3176699433,29cyclictest10783-21taskset19:32:143
3176699433,27cyclictest13052-21taskset19:39:103
3176699433,27cyclictest13052-21taskset19:39:103
3176699423,29cyclictest5775-21taskset21:50:383
3176699423,29cyclictest5775-21taskset21:50:383
3176699423,29cyclictest18532-21taskset22:12:473
3176699423,28cyclictest26203-21chrt23:19:103
3176699423,28cyclictest24881-21taskset20:14:183
3176699423,28cyclictest21719-21taskset21:24:083
3176699423,27cyclictest6727-21chrt20:59:063
3176699422,29cyclictest29421-21chrt20:29:053
3176699422,28cyclictest29888-21chrt00:19:093
3176699422,28cyclictest29888-21chrt00:19:093
3176699422,28cyclictest22513-21taskset22:19:123
3176699422,28cyclictest22513-21taskset22:19:123
3176699413,26cyclictest5065-21taskset20:54:083
3176699413,26cyclictest5065-21taskset20:54:083
3176699412,30cyclictest12553-21taskset23:49:273
3176699403,28cyclictest23037-21taskset20:09:413
3176699403,27cyclictest19504-21taskset19:59:073
3176699403,26cyclictest5282-21taskset19:14:273
3176699403,26cyclictest14656-21taskset19:44:083
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional