You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-08 - 12:46
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot7.osadl.org (updated Mon Dec 08, 2025 00:44:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
18346212943,56sleep118396-21sensors_temp19:04:041
18346212943,56sleep118396-21sensors_temp19:04:041
1880121196,15sleep00-21swapper/019:05:250
1880121196,15sleep00-21swapper/019:05:250
191989911695,14cyclictest31186-21apt-key19:43:242
19178991169,52cyclictest15597-21apt-get22:38:350
19178991169,52cyclictest15597-21apt-get22:38:350
191899910727,27cyclictest0-21swapper/120:18:341
19178991068,26cyclictest181rcu_preempt22:28:380
191789910347,12cyclictest181rcu_preempt21:33:210
19178991023,88cyclictest22556-21apt-get20:54:000
1917899992,72cyclictest10987-21sh00:23:360
19198999820,42cyclictest27278-21sh22:03:322
19189999730,32cyclictest24267-21runrttasks22:53:341
19178999752,23cyclictest181rcu_preempt21:58:240
1917899973,65cyclictest29239-21latency_hist23:58:240
1917899973,65cyclictest29239-21latency_hist23:58:240
183982979,62sleep218460-21sed19:04:052
183982979,62sleep218460-21sed19:04:052
1919899962,47cyclictest21293-21apt-get21:53:322
19189999527,29cyclictest0-21swapper/122:58:361
19198999451,35cyclictest0-21swapper/221:08:492
19198999437,35cyclictest19167-21cyclictest23:33:202
1917899943,83cyclictest207-21systemd-journal20:23:550
1918999934,80cyclictest31388-21apt-get19:43:411
19189999340,23cyclictest0-21swapper/100:24:231
19189999333,22cyclictest3580-21seq23:13:391
19189999331,23cyclictest20798-21runrttasks21:52:511
19189999330,29cyclictest1535-21runrttasks19:49:001
19189999226,27cyclictest12721-21ssh21:38:371
19178999258,13cyclictest181rcu_preempt20:28:520
19189999133,27cyclictest20668-21seq20:48:331
19178999141,13cyclictest181rcu_preempt19:23:220
19198999075,8cyclictest0-21swapper/222:33:572
19198999067,12cyclictest0-21swapper/222:08:532
19189999025,26cyclictest355-21runrttasks00:01:161
19178999041,8cyclictest181rcu_preempt21:59:500
1919899893,48cyclictest15522-21ssh00:31:312
19189998930,26cyclictest7904-21seq23:20:281
19189998929,23cyclictest22438-21seq19:14:381
19189998928,22cyclictest18407-21seq00:37:231
19178998971,11cyclictest4538-21unixbench_multi22:18:580
19178998971,11cyclictest4538-21unixbench_multi22:18:580
19198998849,32cyclictest0-21swapper/222:39:502
19198998849,32cyclictest0-21swapper/222:39:502
1919899883,45cyclictest8683-21seq21:31:112
1919899882,50cyclictest15006-21seq20:29:422
19189998830,20cyclictest1815-21seq23:09:341
19189998829,25cyclictest11238-21seq23:26:481
19189998829,25cyclictest11238-21seq23:26:481
19189998829,22cyclictest29796-21seq22:08:111
19189998827,26cyclictest31247-21runrttasks23:04:111
19189998825,29cyclictest355-21runrttasks21:27:511
1919899873,60cyclictest26839-21modprobe22:58:202
19189998758,20cyclictest20022-21sendmail_mailtr19:09:001
19189998758,20cyclictest20022-21sendmail_mailtr19:09:001
19189998732,23cyclictest24381-21seq21:58:261
19189998730,26cyclictest23161-21seq22:51:021
19189998730,23cyclictest22756-21seq23:46:211
19189998729,21cyclictest19128-21seq20:44:281
19189998729,20cyclictest355-21runrttasks20:58:371
19189998725,26cyclictest12413-21latency_hist21:38:231
19178998765,16cyclictest22272-21apt-key20:53:220
19178998756,22cyclictest20487-21latency_hist20:48:220
19178998746,14cyclictest181rcu_preempt20:08:590
1919899863,47cyclictest3461-21seq19:58:032
19189998628,21cyclictest13989-21seq23:31:221
19189998628,20cyclictest15105-21seq20:31:001
19189998622,28cyclictest2282-21expr19:53:401
19189998620,28cyclictest17683-21runrttasks22:41:551
19189998620,28cyclictest17683-21runrttasks22:41:551
19178998651,11cyclictest181rcu_preempt22:13:430
19198998543,36cyclictest0-21swapper/223:23:202
19189998532,24cyclictest13454-21seq20:25:251
19189998529,20cyclictest6721-21seq20:05:041
19189998528,25cyclictest14898-21seq00:29:201
19189998528,23cyclictest23699-21seq23:48:241
19178998549,12cyclictest181rcu_preempt00:32:240
19178998543,32cyclictest6505-21grep20:04:200
1919899843,44cyclictest18151-21seq00:36:292
1919899842,48cyclictest27323-21seq21:08:172
1919899842,48cyclictest27323-21seq21:08:172
19189998464,14cyclictest207-21systemd-journal23:33:521
19189998426,22cyclictest355-21runrttasks22:25:501
19189998426,22cyclictest355-21runrttasks22:25:501
19189998425,26cyclictest27875-21taskset21:08:421
19178998459,10cyclictest181rcu_preempt22:23:460
19178998459,10cyclictest181rcu_preempt22:23:460
19178998457,13cyclictest181rcu_preempt21:38:060
19178998451,9cyclictest181rcu_preempt21:18:280
19178998451,9cyclictest181rcu_preempt21:18:280
19178998449,13cyclictest181rcu_preempt23:19:070
19178998448,13cyclictest181rcu_preempt00:05:060
19178998443,31cyclictest0-21swapper/022:36:520
19198998363,13cyclictest0-21swapper/220:18:502
1919899835,71cyclictest27177-21apt-get22:58:352
19198998345,34cyclictest19167-21cyclictest21:59:572
1919899834,47cyclictest1794-21seq00:06:312
19198998342,35cyclictest4412-21unixbench_multi23:13:572
1919899832,49cyclictest25817-21seq19:26:202
19189998361,16cyclictest15496-21latency_hist22:38:241
19189998329,23cyclictest29520-21seq19:38:271
19189998326,22cyclictest0-21swapper/122:10:451
19178998359,10cyclictest181rcu_preempt19:43:220
19198998239,35cyclictest0-21swapper/222:28:372
19198998238,35cyclictest0-21swapper/222:28:192
19198998238,35cyclictest0-21swapper/222:28:192
1919899823,49cyclictest8383-21seq20:10:472
1919899823,47cyclictest16846-21seq20:37:442
19189998229,18cyclictest5284-21seq22:20:551
19189998229,18cyclictest5284-21seq22:20:551
19189998229,17cyclictest18224-21seq20:39:261
19189998228,22cyclictest5050-21seq20:02:201
19189998222,28cyclictest22805-21fschecks_time20:54:111
19189998218,28cyclictest0-21swapper/121:18:451
19189998218,28cyclictest0-21swapper/121:18:451
19189998218,26cyclictest0-21swapper/121:29:021
19178998263,11cyclictest27356-21diskmemload23:38:400
19178998263,11cyclictest27356-21diskmemload23:38:400
19178998262,13cyclictest19167-21cyclictest19:13:320
1919899813,48cyclictest20642-21seq20:48:292
1919899813,47cyclictest16552-21seq23:35:192
1919899813,47cyclictest1596-21seq19:49:412
19189998128,25cyclictest7125-21seq00:16:151
19189998128,17cyclictest8331-21seq20:10:061
19189998127,19cyclictest9540-21seq00:20:251
19189998124,24cyclictest0-21swapper/121:47:451
19189998124,24cyclictest0-21swapper/121:47:451
19189998121,28cyclictest10441-21processes22:29:311
19178998158,15cyclictest13609-21ssh21:38:570
19178998152,10cyclictest181rcu_preempt00:34:120
19178998141,17cyclictest181rcu_preempt19:09:020
19178998141,17cyclictest181rcu_preempt19:09:020
19178998139,12cyclictest181rcu_preempt22:08:510
19178998138,33cyclictest0-21swapper/022:48:480
19198998060,15cyclictest6754-21kworker/u18:1+events_unbound21:18:202
19198998033,40cyclictest32054-21modprobe00:03:192
19189998031,19cyclictest355-21runrttasks00:04:491
19189998028,21cyclictest3093-21seq22:18:041
19189998027,18cyclictest25645-21seq19:24:051
19189998022,26cyclictest18999-21memory22:43:481
19189998022,26cyclictest0-21swapper/121:55:021
19178998050,9cyclictest181rcu_preempt23:33:570
19178998049,10cyclictest181rcu_preempt23:05:030
19178998038,12cyclictest181rcu_preempt00:12:060
19178998038,12cyclictest181rcu_preempt00:12:060
1919899794,61cyclictest0-21swapper/219:58:362
19198997932,32cyclictest0-21swapper/222:43:382
19189997918,26cyclictest0-21swapper/121:13:371
19178997960,13cyclictest27356-21diskmemload21:43:430
19178997960,13cyclictest27356-21diskmemload21:43:430
19178997949,20cyclictest3297-21latency_hist23:13:230
19178997945,12cyclictest181rcu_preempt21:18:260
1920599783,40cyclictest0-21swapper/300:23:353
1919899783,68cyclictest0-21swapper/221:33:312
1919899783,41cyclictest0-21swapper/222:18:552
1919899783,41cyclictest0-21swapper/222:18:552
19198997824,43cyclictest292-21dbus-daemon23:43:212
19198997824,43cyclictest292-21dbus-daemon23:43:212
19178997855,10cyclictest20893-21kworker/u17:0+xprtiod23:00:110
19178997850,8cyclictest181rcu_preempt20:18:400
19178997838,10cyclictest181rcu_preempt19:53:430
1917899783,38cyclictest355-21runrttasks22:47:170
1919899774,54cyclictest21377-21netstat23:43:472
19198997736,32cyclictest27053-21grep19:29:002
19198997731,34cyclictest22617-21ls20:54:062
19189997757,11cyclictest0-21swapper/119:29:001
19189997728,20cyclictest4764-21seq00:12:101
19189997728,20cyclictest4764-21seq00:12:101
19189997720,23cyclictest0-21swapper/119:37:051
19189997720,23cyclictest0-21swapper/119:37:051
19178997755,15cyclictest12599-21ssh23:28:490
19178997738,15cyclictest181rcu_preempt21:03:220
19178997737,8cyclictest181rcu_preempt20:33:420
19178997736,10cyclictest181rcu_preempt23:23:380
19178997736,10cyclictest181rcu_preempt23:23:380
19178997734,18cyclictest181rcu_preempt19:33:540
19178997734,18cyclictest181rcu_preempt19:33:540
19178997734,13cyclictest181rcu_preempt19:48:230
19178997723,23cyclictest0-21swapper/019:48:500
19178997720,48cyclictest211rcuc/023:13:360
19198997657,14cyclictest12003-21timerandwakeup00:24:272
19198997654,14cyclictest207-21systemd-journal21:41:352
19198997654,11cyclictest0-21swapper/220:43:242
19198997632,37cyclictest0-21swapper/200:13:412
19198997631,38cyclictest0-21swapper/221:49:022
19198997629,40cyclictest10637-21sh23:25:012
19198997629,40cyclictest10637-21sh23:25:012
19198997621,47cyclictest0-21swapper/222:52:402
19189997618,22cyclictest9284-21sort20:13:481
19189997618,22cyclictest9284-21sort20:13:481
19178997644,13cyclictest181rcu_preempt00:16:330
19178997643,16cyclictest181rcu_preempt21:53:230
19178997642,13cyclictest181rcu_preempt21:23:450
19178997636,8cyclictest181rcu_preempt19:33:240
19178997630,17cyclictest181rcu_preempt21:13:210
19178997629,12cyclictest181rcu_preempt22:56:130
19198997557,13cyclictest19167-21cyclictest19:43:512
19198997536,8cyclictest0-21swapper/200:13:042
19198997536,8cyclictest0-21swapper/200:13:042
19198997536,32cyclictest0-21swapper/223:53:452
19198997536,32cyclictest0-21swapper/223:53:452
1919899753,60cyclictest0-21swapper/220:13:352
1919899753,60cyclictest0-21swapper/220:13:352
19198997531,36cyclictest0-21swapper/223:03:452
19189997530,21cyclictest19694-21seq23:40:541
19189997530,21cyclictest19694-21seq23:40:541
1917899757,38cyclictest376-21sshd23:49:520
19178997553,9cyclictest181rcu_preempt00:21:070
19178997539,13cyclictest181rcu_preempt20:43:230
19178997536,25cyclictest181rcu_preempt23:43:490
19198997453,15cyclictest29904-21kworker/u17:2-rpciod23:09:382
19198997450,15cyclictest21383-21/usr/sbin/munin19:13:512
19198997436,28cyclictest0-21swapper/221:43:592
19198997436,28cyclictest0-21swapper/221:43:592
1919899743,58cyclictest6989-21latency_hist20:08:202
19198997435,32cyclictest316-21rs:main2
19189997453,12cyclictest0-21swapper/123:53:581
19189997453,12cyclictest0-21swapper/123:53:581
19178997452,8cyclictest181rcu_preempt23:58:540
19178997444,14cyclictest181rcu_preempt22:07:570
19198997354,11cyclictest0-21swapper/223:48:582
1919899733,62cyclictest27356-21diskmemload22:13:352
19198997334,32cyclictest0-21swapper/220:59:412
19198997321,44cyclictest207-21systemd-journal21:18:282
19198997321,44cyclictest207-21systemd-journal21:18:282
19178997342,13cyclictest181rcu_preempt19:58:440
19178997341,11cyclictest181rcu_preempt19:25:300
19178997331,8cyclictest181rcu_preempt20:13:440
19178997331,8cyclictest181rcu_preempt20:13:440
19205997211,43cyclictest0-21swapper/320:54:003
19198997252,14cyclictest19167-21cyclictest21:27:382
1919899722,39cyclictest12350-21apt-get20:24:252
19189997238,23cyclictest26006-21apt-get21:03:351
19189997238,23cyclictest26006-21apt-get21:03:351
19178997235,8cyclictest181rcu_preempt21:03:400
19178997235,8cyclictest181rcu_preempt21:03:400
1920599715,39cyclictest0-21swapper/321:59:173
19198997147,17cyclictest0-21swapper/200:18:292
19198997119,45cyclictest20110-21cat19:09:012
19198997119,45cyclictest20110-21cat19:09:012
19189997134,29cyclictest0-21swapper/120:33:341
19198997023,41cyclictest19370-21fschecks_time20:44:482
19189997038,22cyclictest23041-21apt-get19:18:371
1846127028,26sleep30-21swapper/319:04:063
1846127028,26sleep30-21swapper/319:04:063
19205996920,36cyclictest22149-21chrt20:53:223
19198996948,15cyclictest28193-21if_eth019:33:452
19198996948,15cyclictest28193-21if_eth019:33:452
1920599672,42cyclictest0-21swapper/322:28:343
1920599658,24cyclictest19080-21taskset20:43:543
19205996312,39cyclictest0-21swapper/322:39:123
19205996312,39cyclictest0-21swapper/322:39:123
1920599583,39cyclictest24045-21chrt23:48:433
1920599583,38cyclictest10207-21chrt20:18:193
1920599583,38cyclictest10207-21chrt20:18:193
1920599573,35cyclictest895-21kworker/3:1+events23:56:423
1920599573,35cyclictest895-21kworker/3:1+events23:56:423
1920599568,35cyclictest0-21swapper/319:43:413
1920599563,37cyclictest17689-21taskset20:38:523
1920599563,27cyclictest23661-21chrt23:48:233
1920599562,39cyclictest14660-21taskset00:28:553
1920599553,40cyclictest17876-21chrt21:47:483
1920599553,40cyclictest17876-21chrt21:47:483
1920599546,35cyclictest9316-21chrt23:23:393
1920599546,35cyclictest9316-21chrt23:23:393
1920599543,39cyclictest517-21chrt00:03:513
1920599543,37cyclictest10765-21taskset00:23:233
1920599543,36cyclictest18747-21chrt21:48:493
1920599538,30cyclictest0-21swapper/320:23:353
1920599533,36cyclictest1636-21taskset22:13:583
1920599524,31cyclictest2142-21chrt19:53:333
1920599523,37cyclictest15285-21taskset21:43:223
1920599523,36cyclictest6003-21chrt00:13:513
1920599523,34cyclictest444-21chrt23:08:243
1920599523,34cyclictest3955-21chrt00:09:343
1920599523,34cyclictest3955-21chrt00:09:343
1920599523,33cyclictest26815-21taskset21:03:593
1920599523,33cyclictest26815-21taskset21:03:593
1920599523,33cyclictest20886-21chrt19:13:233
1920599523,33cyclictest20886-21chrt19:13:233
1920599522,36cyclictest7565-21chrt22:24:063
1920599522,36cyclictest7565-21chrt22:24:063
1920599522,35cyclictest21526-21taskset22:48:383
1920599514,29cyclictest0-21swapper/320:03:403
1920599513,38cyclictest5322-21chrt23:16:263
1920599513,35cyclictest27844-21chrt19:33:323
1920599513,35cyclictest27844-21chrt19:33:323
1920599513,34cyclictest7757-21chrt20:08:523
1920599513,34cyclictest30179-21chrt23:58:523
1920599513,34cyclictest24591-21chrt22:53:453
1920599513,32cyclictest27780-21chrt19:33:243
1920599512,33cyclictest23215-21chrt19:18:463
1920599503,36cyclictest9050-21chrt23:23:233
1920599503,33cyclictest14295-21chrt20:28:443
1920599502,36cyclictest20576-21chrt23:43:203
1920599502,36cyclictest20576-21chrt23:43:203
1920599502,35cyclictest16456-21taskset23:35:023
1920599502,35cyclictest16054-21chrt20:33:503
1920599502,33cyclictest29734-21chrt19:38:423
1920599502,33cyclictest14541-21chrt23:32:593
1920599493,34cyclictest3847-21chrt22:18:443
1920599493,34cyclictest3847-21chrt22:18:443
1920599492,37cyclictest12088-21chrt21:37:473
1920599484,31cyclictest29996-21chrt22:08:223
1920599483,34cyclictest31582-21chrt23:05:123
1920599483,34cyclictest10635-21taskset20:18:403
1920599483,33cyclictest4062-21chrt19:58:433
1920599482,34cyclictest3370-21chrt21:22:353
1920599482,34cyclictest3370-21chrt21:22:353
1920599482,34cyclictest20795-21chrt22:47:373
1920599482,33cyclictest27979-21chrt22:58:553
1920599482,32cyclictest29296-21taskset21:10:313
1920599473,33cyclictest30196-21chrt22:08:353
1920599473,32cyclictest17840-21chrt00:35:273
1920599472,33cyclictest31921-21taskset21:14:413
1920599472,33cyclictest25195-21taskset19:23:563
1920599472,33cyclictest21796-21chrt19:13:483
1920599463,34cyclictest21472-21chrt21:53:393
1920599462,30cyclictest7840-21chrt21:29:003
1920599453,34cyclictest895-21kworker/3:1+events21:27:513
1920599453,29cyclictest1514-21chrt19:48:593
1920599452,30cyclictest24631-21taskset20:59:253
1920599423,31cyclictest14896-21chrt22:38:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional