You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-08 - 17:58
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot2.osadl.org (updated Tue Sep 08, 2026 12:43:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
30339319915745,100cyclictest0-21swapper/009:21:240
3033931991486,104cyclictest16-21ksoftirqd/012:15:350
3033931991486,104cyclictest16-21ksoftirqd/012:15:350
303393199139123,6cyclictest79-21hwrng11:57:170
30339339913630,100cyclictest10550irq/205-8000000.ethernet-rx009:41:092
3033933991342,121cyclictest3143934-21modprobe10:38:152
303393399129119,6cyclictest79-21hwrng09:20:372
303393399126109,3cyclictest3120470-21ssh10:05:532
303393399126103,8cyclictest3155960-21/usr/sbin/munin10:55:372
303393399126103,8cyclictest3155960-21/usr/sbin/munin10:55:372
303393299123100,19cyclictest3142031-21if_eth110:35:401
30339349912152,47cyclictest0-21swapper/309:40:433
30339329912110,103cyclictest3131663-21modprobe10:21:151
303393499120111,7cyclictest3214130-21latency_hist12:15:003
303393299120110,5cyclictest79-21hwrng12:02:241
303393299120110,5cyclictest79-21hwrng12:02:241
303393499119103,13cyclictest0-21swapper/311:25:133
303393499119103,13cyclictest0-21swapper/311:25:133
3033932991187,43cyclictest3099475-21kworker/u16:9+rpciod09:40:001
30339319911822,19cyclictest3104046-21kworker/u16:20+rpciod10:20:050
3033933991161,4cyclictest3214155-21cut12:15:002
303393399116107,6cyclictest79-21hwrng09:29:502
303393299116107,5cyclictest79-21hwrng11:21:271
303393299116102,8cyclictest0-21swapper/111:25:201
303393299116102,8cyclictest0-21swapper/111:25:201
303393399115104,6cyclictest79-21hwrng08:16:062
30339329911596,14cyclictest0-21swapper/107:21:201
30339329911596,14cyclictest0-21swapper/107:21:201
3033931991141,31cyclictest305434050kworker/u16:16+xprtiod08:40:130
303393199114105,7cyclictest0-21swapper/012:00:220
303393199114105,7cyclictest0-21swapper/012:00:220
30339349911390,20cyclictest10550irq/205-8000000.ethernet-rx011:20:003
303393299112106,4cyclictest301ktimers/111:50:521
303393199112104,5cyclictest79-21hwrng09:10:220
303393199112104,5cyclictest79-21hwrng09:10:220
303393499111100,6cyclictest79-21hwrng10:21:023
30339339911192,16cyclictest381ktimers/210:25:122
30339339911192,16cyclictest381ktimers/210:25:122
30339329911195,13cyclictest79-21hwrng08:22:151
3033933991101,31cyclictest3113227-21ssh09:55:582
30339329911079,28cyclictest79-21hwrng12:22:531
30339329910964,20cyclictest301ktimers/109:50:241
30339329910964,20cyclictest301ktimers/109:50:241
30339329910899,6cyclictest79-21hwrng11:04:021
30339319910899,6cyclictest79-21hwrng12:37:130
30339319910866,30cyclictest3113159-21ssh09:55:540
30339349910710,72cyclictest3141341-21apt-get10:35:123
3033932991074,98cyclictest3188538-21sendmail-msp11:41:251
30339329910698,5cyclictest79-21hwrng10:26:091
30339329910698,5cyclictest79-21hwrng10:26:091
30339319910696,6cyclictest79-21hwrng07:20:480
30339319910696,6cyclictest79-21hwrng07:20:480
30339349910564,25cyclictest45-21rcuc/310:31:143
3033934991055,87cyclictest3164226-21ssh11:05:453
30339329910592,10cyclictest79-21hwrng07:50:301
30339319910591,10cyclictest79-21hwrng09:01:100
30339349910411,69cyclictest3230126-21ntp_states12:36:003
30339339910424,74cyclictest3060149-21sendmail-msp08:21:182
30339329910497,5cyclictest79-21hwrng11:48:041
30339329910495,5cyclictest79-21hwrng10:14:531
3033932991045,89cyclictest3106387-21grep09:46:141
3033933991033,89cyclictest3105661-21/usr/sbin/munin09:45:442
30339319910387,13cyclictest79-21hwrng08:10:590
30339349910254,40cyclictest461ktimers/310:42:123
30339349910254,40cyclictest461ktimers/310:42:123
30339329910277,16cyclictest3053802-21kworker/u16:8+rpciod09:21:131
30339319910238,56cyclictest0-21swapper/011:51:080
30339349910149,16cyclictest3173992-21sendmail-msp11:22:023
3033934991011,18cyclictest3169118-21systemd-userwor11:12:153
30339329910185,5cyclictest79-21hwrng07:26:571
3033932991011,19cyclictest3080173-21ntpq09:10:481
3033932991011,19cyclictest3080173-21ntpq09:10:481
30339319910138,49cyclictest0-21swapper/012:21:480
3033934991001,82cyclictest3185835-21awk11:35:393
30339349910010,54cyclictest0-21swapper/311:45:573
30339339910091,6cyclictest79-21hwrng11:07:072
30339319910090,6cyclictest79-21hwrng11:16:200
30339319910087,6cyclictest79-21hwrng10:10:470
30339319910036,59cyclictest0-21swapper/012:10:150
3033933999960,36cyclictest0-21swapper/210:20:132
3033933999835,50cyclictest0-21swapper/210:00:362
3033933999835,50cyclictest0-21swapper/210:00:362
3033932999889,6cyclictest79-21hwrng10:46:381
3033932999859,34cyclictest0-21swapper/109:25:361
3033931999883,11cyclictest79-21hwrng10:55:510
3033931999883,11cyclictest79-21hwrng10:55:510
3033931999881,6cyclictest79-21hwrng10:43:340
3033931999881,6cyclictest79-21hwrng10:43:340
3033931999868,25cyclictest0-21swapper/011:40:150
303393199984,71cyclictest3173992-21sendmail-msp11:21:390
3033931999834,24cyclictest3186798-21ssh11:36:130
3033934999755,39cyclictest0-21swapper/312:15:133
3033934999755,39cyclictest0-21swapper/312:15:133
3033931999736,44cyclictest0-21swapper/009:15:500
3033931999736,44cyclictest0-21swapper/009:15:500
303393199971,24cyclictest3090105-21/usr/sbin/munin09:25:090
303393399962,69cyclictest3204652-21sh12:01:222
303393399962,69cyclictest3204652-21sh12:01:222
3033933999617,59cyclictest0-21swapper/208:40:422
3033931999687,6cyclictest79-21hwrng08:59:070
3033931999687,6cyclictest79-21hwrng08:59:070
3033931999680,5cyclictest79-21hwrng11:01:590
3033934999589,3cyclictest3115502-21sendmail-msp10:00:593
3033934999589,3cyclictest3115502-21sendmail-msp10:00:593
303393399951,77cyclictest3172796-21kworker/u16:2+rpciod11:20:392
3033932999587,5cyclictest79-21hwrng09:56:271
3033932999586,6cyclictest79-21hwrng07:18:461
3033931999581,11cyclictest79-21hwrng10:08:450
3033931999567,23cyclictest171ktimers/007:55:140
303393499949,48cyclictest0-21swapper/310:05:513
303393499943,36cyclictest3052373-21kworker/u16:1+rpciod08:15:003
3033933999414,76cyclictest3221628-21/usr/sbin/munin12:26:082
3033932999479,12cyclictest79-21hwrng09:16:311
3033932999479,12cyclictest79-21hwrng09:16:311
3033931999475,15cyclictest10550irq/205-8000000.ethernet-rx010:01:020
3033931999475,15cyclictest10550irq/205-8000000.ethernet-rx010:01:020
3033934999373,10cyclictest10550irq/205-8000000.ethernet-rx011:00:553
3033934999368,14cyclictest10550irq/205-8000000.ethernet-rx010:19:593
3033934999336,47cyclictest0-21swapper/312:01:203
3033934999336,47cyclictest0-21swapper/312:01:203
303393399934,10cyclictest3185553-21df11:35:332
303393399932,75cyclictest3217774-21sendmail-msp12:20:412
3033932999379,5cyclictest79-21hwrng10:56:521
3033932999379,5cyclictest79-21hwrng10:56:521
3033931999377,7cyclictest79-21hwrng12:28:000
3033931999343,20cyclictest10550irq/205-8000000.ethernet-rx009:45:100
3033931999325,24cyclictest395-21dbus-broker11:08:250
3033934999239,32cyclictest0-21swapper/307:50:513
3033931999226,25cyclictest3128542-21ssh10:16:220
3033934999187,2cyclictest0-21swapper/308:15:463
3033934999138,21cyclictest3033930-21cyclictest08:25:453
303393399918,72cyclictest10550irq/205-8000000.ethernet-rx012:36:152
3033932999182,6cyclictest79-21hwrng09:05:151
3033932999182,6cyclictest79-21hwrng09:05:151
303393199919,42cyclictest3065979-21apt-get08:35:120
303393199919,42cyclictest3065979-21apt-get08:35:120
3033931999181,6cyclictest79-21hwrng12:31:050
3033931999181,6cyclictest79-21hwrng12:31:050
3033931999179,9cyclictest79-21hwrng10:52:460
3033931999136,34cyclictest3141939-21ssh10:35:390
303393499909,62cyclictest3203370-21latency_hist12:00:013
3033934999016,39cyclictest3046846-21kworker/u16:19+rpciod08:20:123
3033933999062,21cyclictest381ktimers/207:25:132
303393399901,15cyclictest3044393-21ntpq07:35:592
3033932999033,40cyclictest0-21swapper/109:00:411
3033931999019,40cyclictest3207154-21ssh12:05:240
3033931999019,40cyclictest3207154-21ssh12:05:240
3033934998914,62cyclictest0-21swapper/311:40:453
3033933998929,31cyclictest3039376-21kworker/u16:18+xprtiod07:40:152
3033932998958,21cyclictest3067643-21sendmail-msp08:40:241
3033934998868,16cyclictest0-21swapper/308:00:103
3033934998867,18cyclictest461ktimers/309:10:403
3033934998867,18cyclictest461ktimers/309:10:403
3033934998834,30cyclictest461ktimers/309:25:103
303393399881,14cyclictest10550irq/205-8000000.ethernet-rx011:40:472
3033932998873,12cyclictest10550irq/205-8000000.ethernet-rx008:00:571
3033932998822,55cyclictest19-21rcu_preempt12:05:161
3033932998822,55cyclictest19-21rcu_preempt12:05:161
3033931998837,9cyclictest0-21swapper/010:34:590
3033931998821,10cyclictest0-21swapper/009:40:010
3033932998779,5cyclictest79-21hwrng09:33:561
3033931998737,9cyclictest0-21swapper/007:40:540
3033931998726,18cyclictest0-21swapper/008:01:150
303393199871,56cyclictest3182996-21sed11:31:120
3033934998672,6cyclictest3175566-21kworker/u16:16+rpciod12:21:083
3033934998651,29cyclictest0-21swapper/311:00:003
3033934998651,29cyclictest0-21swapper/311:00:003
3033934998651,24cyclictest461ktimers/310:25:453
3033934998651,24cyclictest461ktimers/310:25:453
3033933998637,41cyclictest3152320-21ssh10:50:142
303393399861,13cyclictest3200408-21cut11:55:372
3033932998679,5cyclictest79-21hwrng12:29:021
3033932998670,13cyclictest79-21hwrng11:19:241
3033931998638,43cyclictest0-21swapper/009:40:370
3033933998573,9cyclictest381ktimers/211:54:222
3033932998579,4cyclictest3215470-21ntpq12:16:031
3033932998579,4cyclictest3215470-21ntpq12:16:031
3033932998577,5cyclictest79-21hwrng10:17:581
3033932998563,13cyclictest0-21swapper/108:35:001
3033931998542,39cyclictest0-21swapper/008:20:120
3033931998529,16cyclictest3194670-21sleep11:47:230
3033931998528,22cyclictest3136399-21ssh10:27:410
3033931998528,22cyclictest3136399-21ssh10:27:410
3033933998441,34cyclictest0-21swapper/208:55:012
3033933998441,34cyclictest0-21swapper/208:55:012
303393399842,76cyclictest0-21swapper/211:00:412
3033932998448,30cyclictest0-21swapper/109:40:381
3033931998441,39cyclictest171ktimers/009:30:340
3033933998353,26cyclictest0-21swapper/212:15:232
3033933998353,26cyclictest0-21swapper/212:15:232
3033933998337,41cyclictest0-21swapper/211:30:312
303393399832,75cyclictest3095363-21grep09:31:122
3033933998313,63cyclictest3193481-21ntpq11:45:542
3033932998357,15cyclictest0-21swapper/110:40:281
3033932998357,15cyclictest0-21swapper/110:40:281
3033931998338,34cyclictest0-21swapper/009:50:540
3033931998338,34cyclictest0-21swapper/009:50:540
303393199832,35cyclictest3040030-21sort07:25:290
3033934998256,20cyclictest0-21swapper/309:35:153
3033933998239,10cyclictest0-21swapper/209:50:362
3033933998239,10cyclictest0-21swapper/209:50:362
3033933998234,44cyclictest3084152-21processes09:16:102
3033933998234,44cyclictest3084152-21processes09:16:102
3033932998271,7cyclictest79-21hwrng11:33:441
3033931998235,41cyclictest0-21swapper/011:26:120
3033931998235,41cyclictest0-21swapper/011:26:120
3033931998235,33cyclictest0-21swapper/008:16:050
303393199822,34cyclictest3077231-21/usr/sbin/munin09:05:100
303393199822,34cyclictest3077231-21/usr/sbin/munin09:05:100
3033934998154,20cyclictest0-21swapper/310:10:133
303393399814,12cyclictest3207251-21tail12:05:292
303393399814,12cyclictest3207251-21tail12:05:292
303393399811,28cyclictest3171089-21fschecks_time11:15:372
3033932998172,6cyclictest79-21hwrng11:13:151
3033932998155,15cyclictest0-21swapper/112:35:371
3033931998131,10cyclictest0-21swapper/007:45:350
3033931998131,10cyclictest0-21swapper/007:45:350
3033934998022,48cyclictest0-21swapper/312:25:133
303393399801,26cyclictest3146055-21ssh10:41:012
303393399801,26cyclictest3146055-21ssh10:41:012
3033932998072,5cyclictest79-21hwrng07:44:221
3033932998071,6cyclictest79-21hwrng07:46:241
3033932998071,6cyclictest79-21hwrng07:46:241
3033931998037,11cyclictest171ktimers/007:15:470
3033934997943,22cyclictest0-21swapper/310:55:013
303393399798,56cyclictest3036026-21sshd-session07:15:152
3033933997973,3cyclictest3178920-21ntpq11:25:542
3033933997973,3cyclictest3178920-21ntpq11:25:542
3033933997933,39cyclictest1741-21lldpd07:20:382
3033933997933,39cyclictest1741-21lldpd07:20:382
3033933997918,56cyclictest3051553-21/usr/sbin/munin07:55:392
303393399791,34cyclictest3169510-21ssh11:13:102
303393399791,27cyclictest3052615-21sh08:00:162
3033933997814,57cyclictest0-21swapper/207:34:582
3033933997814,57cyclictest0-21swapper/207:34:582
303393399781,31cyclictest3065979-21apt-get08:35:112
303393399781,31cyclictest3065979-21apt-get08:35:112
303393399781,23cyclictest3078870-21latency_hist09:10:002
303393399781,23cyclictest3078870-21latency_hist09:10:002
303393299784,62cyclictest3137853-21aten2.4-expect10:30:301
3033932997840,30cyclictest3103160-21kworker/u16:2+xprtiod10:01:401
3033932997840,30cyclictest3103160-21kworker/u16:2+xprtiod10:01:401
3033931997835,20cyclictest3049123-21apt-get07:50:240
3033934997763,12cyclictest461ktimers/311:50:593
3033934997748,25cyclictest461ktimers/308:45:233
3033934997748,25cyclictest461ktimers/308:45:233
3033933997754,13cyclictest0-21swapper/208:30:332
303393399771,24cyclictest3075380-21aten_r8power_cu09:00:312
303393399771,17cyclictest3225499-21aten_r8power_en12:30:282
303393399771,17cyclictest3225499-21aten_r8power_en12:30:282
3033932997767,8cyclictest29-21rcuc/111:35:531
3033932997751,14cyclictest0-21swapper/111:05:291
3033933997667,6cyclictest3079724-21gltestperf09:10:362
3033933997667,6cyclictest3079724-21gltestperf09:10:362
3033933997658,15cyclictest381ktimers/207:50:112
3033933997626,36cyclictest1-21systemd07:46:182
3033933997626,36cyclictest1-21systemd07:46:182
3033933997620,52cyclictest2447021-21snmpd07:14:202
3033932997656,18cyclictest0-21swapper/108:55:501
3033932997656,18cyclictest0-21swapper/108:55:501
303393299762,6cyclictest3046853-21kworker/u16:28+rpciod08:20:011
303393299762,5cyclictest3061279-21kworker/u16:5+rpciod08:40:011
303393299762,5cyclictest3061279-21kworker/u16:5+rpciod08:40:011
303393499751,48cyclictest0-21swapper/309:21:403
303393399759,30cyclictest3055044-21/usr/sbin/munin08:05:352
3033933997519,44cyclictest3061279-21kworker/u16:5+rpciod08:25:522
303393399751,32cyclictest3100335-21ssh09:38:552
3033933997510,56cyclictest10450irq/171-8000000.ethernet-tx710:10:042
303393299755,37cyclictest19-21rcu_preempt12:10:051
303393499749,56cyclictest3207714-21/usr/sbin/munin12:05:373
303393499749,56cyclictest3207714-21/usr/sbin/munin12:05:373
303393499743,50cyclictest3075119-21sendmail-msp09:01:133
303393399741,32cyclictest3150070-21find10:46:092
303393399741,25cyclictest3127187-21/usr/sbin/munin10:15:372
3033932997465,6cyclictest0-21swapper/111:55:451
3033931997424,18cyclictest648-21lldpd07:10:210
3033931997424,18cyclictest0-21swapper/008:05:370
303393199741,37cyclictest3070202-21head08:45:350
303393199741,37cyclictest3070202-21head08:45:350
303393199741,31cyclictest3149082-21fschecks_count10:45:350
303393399731,60cyclictest3057455-21sleep08:10:562
3033932997358,9cyclictest79-21hwrng08:12:001
3033931997327,6cyclictest3062610-21fschecks_time08:25:340
303393499724,46cyclictest3151129-21sleep10:47:593
303393499721,56cyclictest3109613-21ntp_states09:51:053
303393499721,56cyclictest3109613-21ntp_states09:51:053
3033933997231,37cyclictest3070553-21ntpq08:45:512
3033933997231,37cyclictest3070553-21ntpq08:45:512
303393399722,4cyclictest1165-21cron08:54:582
3033931997249,19cyclictest0-21swapper/008:35:020
3033934997122,40cyclictest3226391-21ntpq12:30:563
3033934997122,40cyclictest3226391-21ntpq12:30:563
3033933997135,32cyclictest10550irq/205-8000000.ethernet-rx010:30:172
3033932997135,29cyclictest3225411-21ssh12:30:251
3033932997135,29cyclictest3225411-21ssh12:30:251
303393199713,16cyclictest3167631-21irqstats11:10:380
3033934997057,6cyclictest10550irq/205-8000000.ethernet-rx007:41:043
3033934997045,18cyclictest0-21swapper/307:21:243
3033934997045,18cyclictest0-21swapper/307:21:243
3033934997044,19cyclictest0-21swapper/307:15:363
3033931997028,15cyclictest0-21swapper/007:35:010
3033934996950,13cyclictest461ktimers/309:56:013
3033934996931,29cyclictest0-21swapper/308:05:153
3033934996927,35cyclictest0-21swapper/307:26:053
3033933996921,43cyclictest0-21swapper/207:10:002
303393299697,47cyclictest29-21rcuc/108:05:161
3033934996860,5cyclictest3083231-21df09:15:333
3033934996860,5cyclictest3083231-21df09:15:333
3033934996812,43cyclictest0-21swapper/308:40:523
303393199687,50cyclictest16-21ksoftirqd/007:30:220
303393199687,50cyclictest16-21ksoftirqd/007:30:220
3033934996745,18cyclictest0-21swapper/308:50:123
303393499673,55cyclictest3182658-21ntp_states11:31:013
3033934996726,30cyclictest3033930-21cyclictest08:30:093
3033932996761,4cyclictest79-21hwrng07:32:041
3033932996761,4cyclictest79-21hwrng07:32:041
3033932996759,5cyclictest79-21hwrng07:39:141
3033932996653,6cyclictest0-21swapper/110:10:001
3033932996645,19cyclictest301ktimers/108:50:451
3033932996645,17cyclictest0-21swapper/108:25:361
303393299661,55cyclictest3153327-21ssh10:50:511
3033934996527,30cyclictest0-21swapper/309:45:383
3033934996525,33cyclictest3074505-21cat08:56:023
3033934996525,33cyclictest3074505-21cat08:56:023
3033934996451,10cyclictest0-21swapper/308:35:483
3033934996451,10cyclictest0-21swapper/308:35:483
3033934996429,30cyclictest3043781-21diskstats07:35:313
3033934996339,18cyclictest0-21swapper/308:00:003
3033934996328,33cyclictest461ktimers/309:30:223
3033932996344,16cyclictest301ktimers/107:10:141
3033934996236,20cyclictest3078203-21/usr/sbin/munin09:06:053
3033934996236,20cyclictest3078203-21/usr/sbin/munin09:06:053
3033931996235,23cyclictest0-21swapper/008:50:260
3033932995738,7cyclictest3071002-21unixbench_multi08:46:071
3033932995738,7cyclictest3071002-21unixbench_multi08:46:071
3033934995635,17cyclictest0-21swapper/307:10:333
3033934995623,27cyclictest3047674-21grep07:45:343
3033934995623,27cyclictest3047674-21grep07:45:343
3033934995522,28cyclictest0-21swapper/307:30:553
3033934995522,28cyclictest0-21swapper/307:30:553
3033932995534,16cyclictest0-21swapper/107:55:351
3033934995331,18cyclictest3033941-21grep07:10:003
3033932994638,5cyclictest3034074-21latency_hist07:10:011
3033931994024,13cyclictest0-21swapper/007:10:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional