You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-06 - 10:46
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Sat Dec 06, 2025 00:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
17261991203,62cyclictest30588-21apt-get23:08:511
17261991203,62cyclictest30588-21apt-get23:08:511
1106821140,5sleep111069-21apt-get21:38:371
172569911245,38cyclictest28015-21sh23:03:550
172569910944,27cyclictest6946-21taskset23:23:510
17269991076,76cyclictest406-21apt-get19:53:442
17269991063,78cyclictest6891-21apt-get23:23:442
17269991062,73cyclictest22958-21apt-get19:23:542
15762210610,66sleep015763-21/usr/sbin/munin19:03:390
172569910535,31cyclictest0-21swapper/020:18:400
17269991042,80cyclictest22073-21kworker/u17:1+ext4-rsv-conversion23:18:442
172569910354,21cyclictest32637-21apt-key19:53:310
172569910354,21cyclictest32637-21apt-key19:53:310
172569910342,24cyclictest23945-21seq23:53:440
172569910342,20cyclictest10152-21/usr/sbin/munin23:29:230
172569910338,26cyclictest6517-21sh21:31:000
224521020,8sleep30-21swapper/300:12:183
172619910248,48cyclictest8530-21apt-key20:18:321
172619910248,48cyclictest8530-21apt-key20:18:321
172619910242,10cyclictest0-21swapper/121:48:411
17261991023,39cyclictest17639-21grep20:44:011
172569910244,23cyclictest496-21/usr/sbin/munin00:08:510
172569910239,26cyclictest25243-21ssh22:02:540
172619910140,7cyclictest0-21swapper/121:34:361
172569910143,18cyclictest11362-21grep22:34:500
172569910141,23cyclictest7836-21grep20:14:050
172569910141,23cyclictest7836-21grep20:14:050
172569910140,24cyclictest11349-21ssh21:39:280
1337621010,7sleep20-21swapper/222:38:352
1337621010,7sleep20-21swapper/222:38:352
17261991005,34cyclictest10617-21grep20:23:531
172619910039,9cyclictest0-21swapper/123:59:031
17261991003,36cyclictest28080-21fschecks_time19:38:511
1726199994,41cyclictest32705-21runrttasks19:53:311
1726199994,41cyclictest32705-21runrttasks19:53:311
1726199993,51cyclictest10814-21chrt22:34:331
17256999942,22cyclictest18774-21ls20:49:200
17256999941,25cyclictest27187-21irqstats23:58:540
17256999941,22cyclictest2205-21if_err_eth021:23:550
17256999941,19cyclictest5664-21sensors22:24:060
17256999941,19cyclictest5664-21sensors22:24:060
17256999939,26cyclictest29987-21rm00:04:120
17256999939,26cyclictest29987-21rm00:04:120
17261999868,22cyclictest30446-21sh00:05:091
17261999868,22cyclictest30446-21sh00:05:091
17256999841,22cyclictest8819-21ssh00:23:530
17256999841,22cyclictest1374-21ssh21:23:070
17256999841,22cyclictest1374-21ssh21:23:070
17256999840,24cyclictest8462-21grep22:29:040
17256999840,24cyclictest8462-21grep22:29:040
17256999835,23cyclictest17754-21/usr/sbin/munin19:08:520
17261999736,11cyclictest0-21swapper/123:49:001
17261999736,11cyclictest0-21swapper/123:49:001
17261999735,16cyclictest0-21swapper/121:48:301
17261999735,16cyclictest0-21swapper/121:48:301
17261999734,10cyclictest0-21swapper/120:53:301
1726199973,33cyclictest22373-21fschecks_time20:58:511
17256999738,25cyclictest24289-21seq21:03:580
17256999736,22cyclictest0-21swapper/020:53:430
1726199963,39cyclictest30246-21cat23:08:311
1726199963,37cyclictest5438-21ntp_kernel_err22:24:001
1726199963,37cyclictest5438-21ntp_kernel_err22:24:001
17261999633,13cyclictest0-21swapper/120:19:401
1726199962,37cyclictest4598-21head20:04:031
1726199962,37cyclictest4598-21head20:04:031
17256999642,22cyclictest5888-21ssh23:22:010
17256999641,21cyclictest18794-21rm21:51:120
17256999640,24cyclictest21019-21ssh21:54:110
17256999640,20cyclictest25839-21ssh22:59:100
17256999640,19cyclictest23616-21ssh22:56:030
17256999640,19cyclictest23616-21ssh22:56:030
17256999637,27cyclictest21264-21rm22:52:280
17256999636,29cyclictest7936-21apt-get21:34:070
17256999636,26cyclictest355-21runrttasks22:06:110
17256999636,26cyclictest355-21runrttasks22:06:110
17256999636,22cyclictest0-21swapper/021:13:440
1726199954,37cyclictest6808-21latency_hist20:13:311
1726199954,37cyclictest6808-21latency_hist20:13:311
17261999542,12cyclictest207-21systemd-journal23:43:291
17261999542,12cyclictest207-21systemd-journal23:43:291
17261999531,13cyclictest0-21swapper/123:38:301
17256999540,25cyclictest30967-21sh22:12:320
17256999540,21cyclictest18047-21sh22:46:140
17256999539,22cyclictest32148-21ssh23:10:560
17256999539,22cyclictest32148-21ssh23:10:560
17256999539,20cyclictest2759-21ssh23:16:430
17256999538,27cyclictest17057-21rm23:40:470
17256999538,27cyclictest17057-21rm23:40:470
1726199944,37cyclictest31083-21latency_hist21:18:301
17261999435,14cyclictest28870-21sh22:08:481
17256999440,21cyclictest19458-21/usr/sbin/munin19:13:470
17256999438,20cyclictest29188-21latency_hist19:43:300
17256999436,25cyclictest11041-21sensors_temp20:24:040
17256999433,25cyclictest0-21swapper/023:35:550
17256999341,22cyclictest20389-21rm23:47:200
17256999339,23cyclictest7487-21rm00:20:580
17256999339,19cyclictest30135-21switchtime19:44:020
17256999338,22cyclictest21291-21fschecks_count19:18:490
17256999337,20cyclictest355-21runrttasks22:18:450
17256999336,22cyclictest27356-21ssh21:11:290
17256999336,22cyclictest27356-21ssh21:11:290
17256999336,21cyclictest947-21ssh22:16:100
17261999270,16cyclictest1244-21kernelversion23:13:541
17261999235,13cyclictest0-21swapper/120:54:321
1726199923,36cyclictest17496-21cpuspeed19:08:451
17261999211,46cyclictest22958-21apt-get19:23:411
17256999239,21cyclictest15144-21ssh00:35:300
17256999238,25cyclictest5154-21ssh00:17:320
17256999238,25cyclictest5154-21ssh00:17:320
17256999238,21cyclictest26759-21processes19:34:000
17256999238,19cyclictest12824-21rm00:31:210
17256999238,19cyclictest12824-21rm00:31:210
17256999238,18cyclictest4680-21taskset20:04:340
17256999238,18cyclictest4680-21taskset20:04:340
17269999166,17cyclictest16616-21latency_hist21:48:312
17269999166,17cyclictest16616-21latency_hist21:48:312
17261999161,22cyclictest12719-21threads20:29:051
1726199913,37cyclictest25403-21/usr/sbin/munin21:08:541
1726199913,37cyclictest25403-21/usr/sbin/munin21:08:541
17256999155,19cyclictest22958-21apt-get19:24:230
17256999142,41cyclictest17712-21tail20:44:010
17256999136,18cyclictest15126-21ssh22:40:590
17256999136,18cyclictest15126-21ssh22:40:590
1726999903,63cyclictest26458-40logrotate23:58:282
17256999037,23cyclictest15124-21taskset21:44:430
17256999037,23cyclictest15124-21taskset21:44:430
17256999033,21cyclictest0-21swapper/019:29:030
17261998966,16cyclictest20851-21sendmail19:18:281
1726199894,35cyclictest21128-21cpu19:18:441
1726199893,40cyclictest4356-21perl23:19:161
1726199893,34cyclictest355-21runrttasks22:08:171
1726199893,34cyclictest355-21runrttasks22:08:171
1726199893,34cyclictest1605-21latency_hist21:23:301
1726199893,34cyclictest1605-21latency_hist21:23:301
17256998931,22cyclictest16277-21chrt20:40:110
17269998865,15cyclictest4562-21latency_hist21:28:302
1726199889,41cyclictest6891-21apt-get23:23:521
1726199883,39cyclictest27665-21latency_hist19:38:311
17256998856,24cyclictest355-21runrttasks20:28:450
1727399874,48cyclictest0-21swapper/321:33:433
17269998759,20cyclictest21998-21latency_hist20:58:302
1726199873,36cyclictest12340-21ssh23:33:281
1726199873,34cyclictest23923-21/usr/sbin/munin21:59:061
17256998746,28cyclictest0-21swapper/020:08:430
17256998746,28cyclictest0-21swapper/020:08:430
17256998742,36cyclictest22903-21rm23:51:180
17256998742,36cyclictest22903-21rm23:51:180
1726999862,65cyclictest4584-21kworker/u17:2+ext4-rsv-conversion23:29:132
17256998656,21cyclictest2039-21apt-get19:58:440
166122867,55sleep216706-21unixbench_multi19:04:142
1726199853,36cyclictest25900-21modprobe19:33:281
17256998535,17cyclictest23383-21taskset21:02:130
17269998463,13cyclictest32746-21kworker/u17:3-rpciod00:00:542
17269998460,16cyclictest28180-21latency_hist21:13:312
17269998460,16cyclictest28180-21latency_hist21:13:312
17269998363,12cyclictest1-21systemd22:33:292
17269998363,12cyclictest1-21systemd22:33:292
1726999834,51cyclictest29854-21apt-get00:04:382
1726999834,51cyclictest29854-21apt-get00:04:382
17256998343,27cyclictest986-21ntpq19:54:360
104812830,8sleep30-21swapper/323:29:313
244722820,7sleep225101-21diskmemload22:00:402
17269998259,18cyclictest355-21runrttasks21:53:362
17261998260,16cyclictest314-21in:imuxsock21:56:091
17256998236,14cyclictest13544-21taskset20:33:330
1726999817,48cyclictest16963-21apt-get21:48:432
17269998158,14cyclictest355-21runrttasks21:08:312
1726199813,33cyclictest1960-21cstates21:23:481
17269998055,17cyclictest17244-21cyclictest00:14:052
17269998055,17cyclictest17244-21cyclictest00:14:052
17273997911,51cyclictest0-21swapper/323:19:043
17269997955,17cyclictest4584-21kworker/u17:2-rpciod23:03:442
17269997951,19cyclictest20010-21latency_hist20:53:302
1713427912,42sleep117131-21munin-run19:08:291
17269997858,12cyclictest0-21swapper/221:15:272
1727399776,44cyclictest0-21swapper/323:23:443
17261997752,17cyclictest13940-21sh22:38:581
17261997752,17cyclictest13940-21sh22:38:581
1726999766,56cyclictest11103-21ssh21:38:442
17269997658,12cyclictest355-21runrttasks22:53:292
17269997656,14cyclictest28677-21/usr/sbin/munin22:08:482
17269997631,25cyclictest39-21ksoftirqd/222:13:562
17261997653,17cyclictest766-21sh00:09:011
17269997542,23cyclictest32703-21apt-config19:53:322
17269997542,23cyclictest32703-21apt-config19:53:322
1726199757,45cyclictest26501-21munin-run23:58:291
17261997553,14cyclictest6891-21sh00:19:081
1727399744,55cyclictest0-21swapper/323:58:363
17269997451,14cyclictest0-21swapper/220:14:022
17269997451,14cyclictest0-21swapper/220:14:022
1726999744,37cyclictest30588-21apt-get23:08:462
1726999744,37cyclictest30588-21apt-get23:08:462
1726999743,50cyclictest8218-21apt-get20:18:422
1726199749,22cyclictest406-21apt-get19:53:411
17269997357,10cyclictest14917-21munin-plugin-st20:38:282
17261997355,12cyclictest18807-21ntp_kernel_pll_23:43:571
17269997248,14cyclictest0-21swapper/223:18:322
17269997142,21cyclictest6703-21latency_hist20:13:302
17269997142,21cyclictest6703-21latency_hist20:13:302
1726999713,41cyclictest355-21runrttasks22:48:182
17269997111,34cyclictest10805-21ssh22:34:322
17261997152,11cyclictest0-21swapper/100:34:021
17261997148,17cyclictest25355-21sh22:59:001
17261997139,22cyclictest9276-21find00:24:041
1726999704,35cyclictest39-21ksoftirqd/221:19:092
1726999704,35cyclictest39-21ksoftirqd/221:19:092
1726999703,54cyclictest21095-21ssh23:48:392
1726999703,54cyclictest21095-21ssh23:48:392
1726999703,43cyclictest18989-21service19:13:322
1726999703,30cyclictest29513-21cstates19:43:462
17261997046,15cyclictest22195-21sh22:53:511
17261997046,15cyclictest22195-21sh22:53:511
1726199703,45cyclictest15087-21latency_hist20:38:311
17261997032,29cyclictest17221-21ls22:44:041
17273996912,37cyclictest0-21swapper/321:48:593
17269996945,17cyclictest17244-21cyclictest22:20:162
17269996941,20cyclictest8874-21sh00:23:532
17269996938,22cyclictest9392-21sh21:35:152
17261996947,11cyclictest0-21swapper/122:49:021
1727399688,42cyclictest0-21swapper/300:04:023
1727399688,42cyclictest0-21swapper/300:04:023
1727399687,47cyclictest0-21swapper/322:34:333
17269996846,12cyclictest0-21swapper/220:28:302
1726999684,42cyclictest26455-21perl19:33:512
1726999682,37cyclictest39-21ksoftirqd/222:06:512
1726999682,37cyclictest39-21ksoftirqd/222:06:512
17261996844,16cyclictest25101-21diskmemload22:33:111
17261996844,16cyclictest25101-21diskmemload22:33:111
1726999675,35cyclictest39-21ksoftirqd/222:53:592
1726999675,35cyclictest39-21ksoftirqd/222:53:592
17269996747,10cyclictest0-21swapper/222:58:492
17269996741,14cyclictest0-21swapper/220:43:312
17269996724,7cyclictest371rcuc/220:43:482
17261996748,13cyclictest31977-21sh22:13:551
17273996611,38cyclictest0-21swapper/320:54:043
17269996646,12cyclictest0-21swapper/200:34:062
17269996639,20cyclictest0-21swapper/223:43:312
17269996639,20cyclictest0-21swapper/223:43:312
1726999663,41cyclictest355-21runrttasks19:15:432
1726999663,41cyclictest18520-21fschecks_time23:43:512
1726999662,43cyclictest22786-21apt-config19:23:312
1726199663,45cyclictest2244-21fschecks_count19:58:501
17269996540,14cyclictest0-21swapper/221:28:502
1726999653,45cyclictest3010-21grep19:59:052
17269996524,33cyclictest23016-21timerwakeupswit20:59:052
1726999652,33cyclictest39-21ksoftirqd/223:37:262
1726999652,32cyclictest39-21ksoftirqd/200:30:222
1726999652,32cyclictest39-21ksoftirqd/200:30:222
1726999652,26cyclictest39-21ksoftirqd/200:12:422
17261996550,10cyclictest23193-21kworker/u17:0-writeback21:33:181
17261996545,14cyclictest3238-21fschecks_time00:13:501
17261996545,14cyclictest3238-21fschecks_time00:13:501
1726199654,41cyclictest355-21runrttasks21:03:451
17261996540,15cyclictest0-21swapper/122:19:071
1595526513,35sleep30-21swapper/319:03:543
1726999644,38cyclictest355-21runrttasks20:07:232
1726999644,38cyclictest355-21runrttasks20:07:232
1726999643,33cyclictest39-21ksoftirqd/222:26:182
1726999643,33cyclictest39-21ksoftirqd/222:26:182
1726999642,43cyclictest28027-21fschecks_time19:38:502
17269996419,34cyclictest25417-21timerwakeupswit19:29:032
1726199644,30cyclictest355-21runrttasks20:39:381
14992640,6sleep30-21swapper/319:55:273
17273996315,27cyclictest0-21swapper/323:08:513
17273996315,27cyclictest0-21swapper/323:08:513
17261996344,13cyclictest30835-21latency_hist19:48:301
1726199633,40cyclictest12149-21tail00:29:071
1726199633,40cyclictest12149-21tail00:29:071
17269996237,14cyclictest0-21swapper/220:28:592
1726999623,42cyclictest6046-21fschecks_count00:18:482
1727399585,30cyclictest0-21swapper/319:23:433
1727399573,42cyclictest19690-21chrt22:48:583
1727399573,39cyclictest21573-21taskset23:48:533
1727399573,39cyclictest21573-21taskset23:48:533
1727399565,40cyclictest26838-21taskset23:58:463
1727399563,38cyclictest1984-21chrt22:18:323
1727399553,37cyclictest26821-21chrt19:34:013
1727399553,35cyclictest25284-21taskset21:08:313
1727399553,34cyclictest16805-21taskset21:48:323
1727399553,34cyclictest16805-21taskset21:48:323
1727399544,38cyclictest7238-21chrt20:13:543
1727399544,38cyclictest7238-21chrt20:13:543
1727399542,31cyclictest895-21kworker/3:1+events20:43:313
1727399534,39cyclictest12384-21chrt00:29:453
1727399534,39cyclictest12384-21chrt00:29:453
1727399533,41cyclictest895-21kworker/3:1+events00:22:573
1727399533,39cyclictest28269-21taskset23:04:023
1727399533,33cyclictest22271-21chrt20:58:473
1727399532,34cyclictest25813-21chrt22:03:453
1727399532,34cyclictest25813-21chrt22:03:453
1727399532,33cyclictest965-21taskset23:13:463
1727399523,39cyclictest32332-21chrt21:19:053
1727399523,39cyclictest32332-21chrt21:19:053
1727399522,39cyclictest24666-21taskset22:01:133
1727399522,36cyclictest16983-21chrt20:43:473
1727399522,35cyclictest12770-21chrt23:33:453
1727399513,38cyclictest13251-21chrt21:42:453
1727399513,35cyclictest19465-21chrt20:49:383
1727399513,34cyclictest28971-21taskset22:08:513
1727399513,33cyclictest17573-21taskset19:08:463
1727399513,32cyclictest16901-21chrt22:43:593
1727399512,39cyclictest10405-21taskset00:26:533
1727399503,35cyclictest6522-21chrt21:31:013
1727399503,35cyclictest29398-21chrt21:14:063
1727399503,33cyclictest13966-21chrt00:33:503
1727399502,39cyclictest21266-21taskset19:18:463
1727399502,36cyclictest11685-21chrt20:28:283
1727399502,34cyclictest13352-21taskset20:33:303
1727399494,33cyclictest4717-21chrt22:23:313
1727399494,32cyclictest10090-21taskset22:33:283
1727399494,32cyclictest10090-21taskset22:33:283
1727399493,34cyclictest17423-21taskset23:42:003
1727399493,34cyclictest17423-21taskset23:42:003
1727399492,33cyclictest5221-21chrt20:08:313
1727399483,33cyclictest8747-21taskset20:18:403
1727399483,30cyclictest15487-21chrt22:42:053
1727399483,30cyclictest15487-21chrt22:42:053
1727399482,37cyclictest22447-21chrt21:58:223
1727399482,36cyclictest20306-21chrt19:14:053
1727399482,32cyclictest6202-21chrt22:24:523
1727399482,32cyclictest6202-21chrt22:24:523
17273994814,24cyclictest5429-21chrt00:18:263
17273994814,24cyclictest5429-21chrt00:18:263
1727399474,34cyclictest4412-21chrt20:04:023
1727399473,34cyclictest19828-21chrt23:45:363
1727399473,31cyclictest6152-21chrt20:09:083
1727399473,31cyclictest6152-21chrt20:09:083
1727399472,34cyclictest27581-21chrt21:12:083
1727399472,34cyclictest27581-21chrt21:12:083
1727399472,31cyclictest26382-21chrt23:00:533
1727399464,33cyclictest3446-21chrt21:25:383
1727399463,32cyclictest895-21kworker/3:1+events19:28:563
1727399463,32cyclictest21841-21chrt22:53:323
1727399463,32cyclictest21841-21chrt22:53:323
1727399463,30cyclictest27953-21chrt19:38:473
1727399463,29cyclictest2319-21chrt19:58:513
1727399462,34cyclictest14925-21taskset20:38:283
1727399443,28cyclictest32388-21chrt19:53:283
1727399443,28cyclictest32388-21chrt19:53:283
1727399423,30cyclictest30856-21chrt19:48:303
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional