You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-12 - 14:56
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot2.osadl.org (updated Sat Sep 12, 2026 12:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
38076349913682,51cyclictest10450irq/171-8000000.ethernet-tx712:20:160
380763599134115,7cyclictest0-21swapper/111:35:001
38076359913381,48cyclictest3918188-21sendmail-msp10:46:091
3807636991312,108cyclictest0-21swapper/208:21:172
380763599131117,7cyclictest0-21swapper/107:29:581
380763599131116,11cyclictest79-21hwrng09:30:501
380763699128117,8cyclictest0-21swapper/212:25:332
38076359912647,7cyclictest0-21swapper/112:30:351
38076369912588,30cyclictest79-21hwrng10:27:092
38076369912588,30cyclictest79-21hwrng10:27:092
38076359912439,46cyclictest301ktimers/107:45:311
38076359912439,46cyclictest301ktimers/107:45:311
38076379912326,64cyclictest649-21containerd08:35:183
38076369912397,22cyclictest0-21swapper/212:00:562
38076369912396,24cyclictest10550irq/205-8000000.ethernet-rx008:54:582
380763699123113,6cyclictest79-21hwrng11:01:582
380763699122109,8cyclictest79-21hwrng08:16:052
380763599120111,5cyclictest79-21hwrng11:41:541
380763599119110,7cyclictest0-21swapper/111:01:221
380763699118110,5cyclictest79-21hwrng08:45:472
380763699118110,5cyclictest79-21hwrng08:45:472
380763599118109,5cyclictest79-21hwrng07:43:191
380763699117107,5cyclictest79-21hwrng10:42:312
380763699117107,5cyclictest79-21hwrng10:42:312
380763599117102,6cyclictest79-21hwrng07:58:401
38076349911784,18cyclictest3902701-21kworker/u16:7+xprtiod10:41:050
38076349911784,18cyclictest3902701-21kworker/u16:7+xprtiod10:41:050
38076369911684,29cyclictest3990872-21sendmail-msp12:20:292
38076349911599,6cyclictest79-21hwrng11:15:170
38076349911599,6cyclictest79-21hwrng11:15:170
3807634991141,79cyclictest3996051-21/usr/sbin/munin12:26:070
38076379911275,26cyclictest461ktimers/308:50:183
3807635991128,82cyclictest3990872-21sendmail-msp12:20:401
3807635991126,45cyclictest3975117-21kworker/u16:15+rpciod12:00:001
38076349911299,10cyclictest3897305-21cat10:10:360
380763799110103,4cyclictest10550irq/205-8000000.ethernet-rx009:40:393
38076369911097,6cyclictest79-21hwrng09:25:432
38076359911094,6cyclictest79-21hwrng08:50:541
380763599110102,5cyclictest79-21hwrng11:50:061
380763599110102,5cyclictest79-21hwrng11:50:061
380763799109103,3cyclictest3918188-21sendmail-msp10:45:213
38076369910941,63cyclictest0-21swapper/211:10:582
38076369910941,63cyclictest0-21swapper/211:10:582
38076369910933,16cyclictest3964443-21kworker/u16:12+xprtiod11:50:162
38076369910933,16cyclictest3964443-21kworker/u16:12+xprtiod11:50:162
38076359910982,18cyclictest10550irq/205-8000000.ethernet-rx010:41:071
38076359910982,18cyclictest10550irq/205-8000000.ethernet-rx010:41:071
3807635991095,98cyclictest0-21swapper/109:55:451
380763599109101,6cyclictest0-21swapper/109:21:361
38076369910893,4cyclictest79-21hwrng11:08:072
38076359910893,9cyclictest79-21hwrng10:29:121
38076359910893,9cyclictest79-21hwrng10:29:121
3807635991083,81cyclictest0-21swapper/109:05:451
38076369910797,6cyclictest79-21hwrng08:05:512
38076369910792,10cyclictest79-21hwrng12:37:122
38076369910715,27cyclictest3962082-21apt-get11:40:262
3807637991063,99cyclictest3892779-21latency_hist10:04:593
38076369910641,17cyclictest0-21swapper/208:00:432
38076369910641,17cyclictest0-21swapper/208:00:432
3807635991066,77cyclictest3940611-21df11:10:361
3807635991066,77cyclictest3940611-21df11:10:361
38076379910598,5cyclictest79-21hwrng12:08:323
38076379910590,9cyclictest79-21hwrng11:55:133
38076369910586,16cyclictest0-21swapper/207:24:592
38076369910586,16cyclictest0-21swapper/207:24:592
38076369910584,11cyclictest3807633-21cyclictest12:33:062
3807636991052,96cyclictest0-21swapper/210:01:182
38076369910469,30cyclictest3856621-21ssh09:15:132
38076369910469,30cyclictest3856621-21ssh09:15:132
38076369910445,19cyclictest0-21swapper/209:10:562
3807636991043,58cyclictest3874573-21sendmail-msp09:40:582
38076359910457,36cyclictest0-21swapper/108:34:581
38076369910388,6cyclictest79-21hwrng07:15:402
38076369910388,5cyclictest79-21hwrng11:27:342
3807634991031,88cyclictest0-21swapper/010:55:450
3807637991021,98cyclictest3946813-21sh11:19:243
3807637991021,98cyclictest3946813-21sh11:19:243
38076369910246,7cyclictest0-21swapper/211:21:122
3807634991027,62cyclictest10450irq/171-8000000.ethernet-tx712:00:410
38076369910185,12cyclictest79-21hwrng08:35:322
38076369910184,6cyclictest79-21hwrng12:11:362
3807636991011,51cyclictest3976181-21sh11:59:392
38076359910194,4cyclictest79-21hwrng12:29:011
38076359910194,4cyclictest79-21hwrng10:58:541
3807637991004,79cyclictest0-21swapper/310:21:033
38076359910087,7cyclictest79-21hwrng09:27:461
380763799995,88cyclictest3990872-21sendmail-msp12:20:413
380763799982,24cyclictest3883327-21ntpq09:51:093
3807636999884,11cyclictest381ktimers/211:15:282
3807636999884,11cyclictest381ktimers/211:15:282
3807635999889,5cyclictest79-21hwrng11:18:211
3807635999889,5cyclictest79-21hwrng11:18:211
380763499988,64cyclictest10250irq/155-8000000.ethernet-tx510:31:090
3807635999790,5cyclictest79-21hwrng11:49:041
3807635999787,7cyclictest79-21hwrng10:51:441
3807635999782,11cyclictest10550irq/205-8000000.ethernet-rx009:40:261
3807634999786,8cyclictest21-21rcuc/009:42:210
3807634999773,17cyclictest0-21swapper/011:20:460
3807636999659,31cyclictest0-21swapper/210:56:072
3807636999657,34cyclictest0-21swapper/209:50:122
3807636999632,26cyclictest0-21swapper/207:50:092
3807635999681,6cyclictest79-21hwrng08:15:031
3807634999664,27cyclictest0-21swapper/008:20:160
3807637999572,19cyclictest0-21swapper/312:00:153
380763699956,64cyclictest3869968-21kworker/u16:3+rpciod09:59:592
3807636999531,25cyclictest3861253-21ssh09:20:512
380763599956,8cyclictest657-21containerd12:01:211
3807634999576,16cyclictest171ktimers/008:05:120
3807637999487,5cyclictest3961787-21sendmail-msp11:40:423
3807637999446,44cyclictest1-21systemd07:45:313
3807637999446,44cyclictest1-21systemd07:45:313
380763699943,62cyclictest3910612-21sh10:30:162
380763699934,14cyclictest3893221-21aten_r8power_fr10:05:302
380763699934,14cyclictest3893221-21aten_r8power_fr10:05:302
380763699933,57cyclictest3988592-21ssh12:15:542
3807637999285,4cyclictest3947187-21sendmail-msp11:20:573
380763699925,9cyclictest3903633-21sendmail-msp10:19:582
3807636999256,28cyclictest0-21swapper/207:25:122
3807636999174,7cyclictest3899006-21kworker/u16:0+xprtiod10:45:062
3807636999136,20cyclictest0-21swapper/211:35:202
3807637999050,22cyclictest0-21swapper/309:21:163
3807636999032,25cyclictest3967348-21ssh11:46:132
380763499903,28cyclictest3816815-21kworker/u16:9+rpciod08:39:590
3807636998981,5cyclictest79-21hwrng09:32:532
3807636998970,6cyclictest79-21hwrng10:22:022
380763699896,55cyclictest3981439-21modprobe12:06:062
3807636998946,14cyclictest0-21swapper/208:55:332
3807636998946,14cyclictest0-21swapper/208:55:332
3807635998980,6cyclictest79-21hwrng08:27:211
3807634998980,4cyclictest0-21swapper/009:50:390
3807634998966,15cyclictest171ktimers/011:35:430
3807634998939,41cyclictest3859992-21sendmail-msp09:20:260
3807637998882,4cyclictest10550irq/205-8000000.ethernet-rx010:43:203
3807637998882,4cyclictest10550irq/205-8000000.ethernet-rx010:43:203
3807636998844,6cyclictest381ktimers/209:05:132
3807637998773,10cyclictest3951782-21interrupts11:25:393
3807636998738,17cyclictest0-21swapper/207:40:452
3807635998780,5cyclictest79-21hwrng10:13:511
3807635998771,6cyclictest79-21hwrng08:22:141
3807637998655,21cyclictest0-21swapper/308:20:163
3807636998678,5cyclictest79-21hwrng10:54:482
3807636998677,6cyclictest79-21hwrng09:39:022
3807636998633,14cyclictest3897656-21ssh10:10:502
3807635998679,5cyclictest79-21hwrng11:28:361
380763599863,61cyclictest3901311-21sshd10:15:511
380763799853,16cyclictest3984941-21ntpq12:10:583
3807635998572,11cyclictest301ktimers/110:33:191
3807635998554,24cyclictest301ktimers/109:15:511
3807635998554,24cyclictest301ktimers/109:15:511
3807634998578,5cyclictest0-21swapper/009:30:170
3807634998528,54cyclictest0-21swapper/011:10:010
3807637998431,18cyclictest4002057-21apt-get12:35:113
3807635998310,33cyclictest3848874-21sendmail-msp09:01:121
3807637998259,18cyclictest461ktimers/309:25:123
3807634998266,12cyclictest0-21swapper/010:21:280
3807634998256,21cyclictest0-21swapper/011:41:310
3807634998238,35cyclictest21-21rcuc/011:25:500
3807637998172,7cyclictest0-21swapper/308:19:593
380763799811,66cyclictest3929639-21grep10:55:303
380763799811,48cyclictest45-21rcuc/311:50:173
380763799811,48cyclictest45-21rcuc/311:50:173
3807636998170,5cyclictest79-21hwrng07:48:262
3807636998170,5cyclictest79-21hwrng07:48:262
3807636998168,10cyclictest79-21hwrng07:59:422
3807635998156,20cyclictest301ktimers/107:35:141
3807635998151,18cyclictest0-21swapper/111:21:071
380763599812,52cyclictest3826379-21sendmail-msp08:00:381
380763599812,52cyclictest3826379-21sendmail-msp08:00:381
3807636998058,12cyclictest381ktimers/208:25:152
3807635998036,41cyclictest0-21swapper/112:15:331
3807634998071,7cyclictest21-21rcuc/010:35:400
380763499805,55cyclictest3925678-21ssh10:50:110
3807634998053,20cyclictest0-21swapper/007:21:030
3807634998053,20cyclictest0-21swapper/007:21:030
3807634998039,33cyclictest0-21swapper/008:41:210
380763499801,3cyclictest0-21swapper/009:40:000
3807637997970,6cyclictest79-21hwrng08:56:013
3807637997970,6cyclictest79-21hwrng08:56:013
3807637997955,21cyclictest461ktimers/312:30:133
3807637997951,23cyclictest0-21swapper/311:11:053
3807637997951,23cyclictest0-21swapper/311:11:053
380763799791,50cyclictest3811394-21sendmail-msp07:21:083
380763799791,50cyclictest3811394-21sendmail-msp07:21:083
380763599799,11cyclictest19-21rcu_preempt09:50:341
3807634997967,9cyclictest171ktimers/007:50:130
3807634997961,15cyclictest0-21swapper/010:00:550
3807634997948,29cyclictest171ktimers/011:50:070
3807634997948,29cyclictest171ktimers/011:50:070
380763499791,57cyclictest0-21swapper/008:01:010
380763499791,57cyclictest0-21swapper/008:01:010
3807634997913,52cyclictest21-21rcuc/011:11:000
3807634997913,52cyclictest21-21rcuc/011:11:000
380763799787,52cyclictest3939953-21sh11:09:593
3807637997851,17cyclictest0-21swapper/307:25:113
3807636997833,18cyclictest0-21swapper/207:40:002
3807635997835,41cyclictest10050irq/139-8000000.ethernet-tx309:45:251
380763599781,62cyclictest3984291-21diskstats12:10:371
3807635997733,22cyclictest3889126-21sendmail-msp10:00:271
3807634997770,4cyclictest171ktimers/010:05:470
3807634997770,4cyclictest171ktimers/010:05:470
380763499775,67cyclictest3932697-21sendmail-msp11:02:200
3807634997738,20cyclictest0-21swapper/010:45:420
3807637997653,19cyclictest461ktimers/309:45:123
3807637997653,18cyclictest0-21swapper/309:11:113
380763799761,41cyclictest0-21swapper/309:00:173
3807635997650,18cyclictest301ktimers/107:10:161
3807635997635,31cyclictest19-21rcu_preempt10:35:451
3807635997630,27cyclictest3935392-21kworker/u16:21+xprtiod11:10:021
3807637997565,6cyclictest3916502-21unixbench_singl10:36:143
3807637997547,25cyclictest461ktimers/311:45:143
380763799753,53cyclictest3934020-21ld11:00:583
3807636997542,18cyclictest0-21swapper/208:40:132
3807635997530,41cyclictest3954827-21ssh11:30:231
3807635997530,41cyclictest3954827-21ssh11:30:231
3807634997559,14cyclictest171ktimers/007:10:530
3807634997535,22cyclictest0-21swapper/007:25:200
380763499751,55cyclictest3853332-21diskstats09:10:330
3807637997453,12cyclictest461ktimers/309:05:103
380763599748,38cyclictest19-21rcu_preempt10:09:591
380763599748,38cyclictest19-21rcu_preempt10:09:591
3807636997366,4cyclictest79-21hwrng08:14:022
3807636997366,4cyclictest79-21hwrng08:14:022
3807636997360,9cyclictest381ktimers/211:33:162
3807636997360,9cyclictest381ktimers/211:33:162
3807634997338,32cyclictest9950irq/131-8000000.ethernet-tx209:45:120
3807637997248,20cyclictest0-21swapper/307:55:323
3807637997233,30cyclictest3807633-21cyclictest10:25:523
3807637997233,30cyclictest3807633-21cyclictest10:25:523
3807634997266,4cyclictest171ktimers/012:36:070
3807637997160,4cyclictest3857797-21ntp_states09:16:053
3807637997160,4cyclictest3857797-21ntp_states09:16:053
3807637997041,22cyclictest0-21swapper/311:35:343
3807636997061,6cyclictest79-21hwrng09:48:152
380763699701,46cyclictest19-21rcu_preempt10:38:052
3807635997050,16cyclictest301ktimers/109:11:191
3807635997040,25cyclictest0-21swapper/108:56:071
3807635997040,25cyclictest0-21swapper/108:56:071
3807634997048,16cyclictest0-21swapper/009:30:000
380763599698,54cyclictest3871195-21apt-get09:35:251
3807634996963,4cyclictest3839561-21latency_hist08:34:590
3807634996952,14cyclictest171ktimers/008:55:210
3807634996952,14cyclictest171ktimers/008:55:210
3807634996947,15cyclictest3807633-21cyclictest07:15:470
3807637996849,13cyclictest0-21swapper/311:30:363
3807637996849,13cyclictest0-21swapper/311:30:363
3807637996841,19cyclictest0-21swapper/307:40:413
380763799682,10cyclictest3900948-21irqstats10:15:363
3807635996842,22cyclictest301ktimers/107:50:101
380763499686,59cyclictest3833933-21wc08:19:590
3807634996842,18cyclictest0-21swapper/012:05:350
3807634996830,19cyclictest3975117-21kworker/u16:15+rpciod12:00:000
380763499682,27cyclictest3987287-21ssh12:14:590
3807634996821,40cyclictest3987517-21ssh12:15:100
3807637996748,15cyclictest0-21swapper/309:58:033
3807635996743,20cyclictest0-21swapper/112:36:141
3807635996743,18cyclictest0-21swapper/110:20:151
380763499674,5cyclictest3906350-21kworker/u16:19+rpciod10:29:580
380763499674,5cyclictest3906350-21kworker/u16:19+rpciod10:29:580
3807637996639,19cyclictest0-21swapper/308:40:503
3807635996641,21cyclictest301ktimers/108:05:211
3807634996644,20cyclictest171ktimers/007:30:150
3807637996549,12cyclictest461ktimers/310:05:153
3807637996549,12cyclictest461ktimers/310:05:153
3807637996545,14cyclictest461ktimers/308:30:103
3807634996546,7cyclictest3818885-21sendmail-msp07:40:150
3807634996527,31cyclictest3856634-21ssh09:15:150
3807634996527,31cyclictest3856634-21ssh09:15:150
3807637996450,12cyclictest461ktimers/309:35:353
3807636996432,27cyclictest0-21swapper/209:00:572
3807635996430,28cyclictest3840556-21ntpq08:35:531
3807635996429,14cyclictest3805792-21kworker/u16:22+rpciod07:20:161
3807635996429,14cyclictest3805792-21kworker/u16:22+rpciod07:20:161
3807635996412,50cyclictest3980199-21apt-get12:05:131
380763499645,46cyclictest16-21ksoftirqd/011:47:510
3807634996442,17cyclictest0-21swapper/007:39:590
380763499641,47cyclictest3843796-21fschecks_count08:45:330
380763499641,47cyclictest3843796-21fschecks_count08:45:330
3807634996413,47cyclictest3807633-21cyclictest12:31:060
3807636996340,19cyclictest0-21swapper/208:34:592
3807637996245,6cyclictest3926636-21ntpq10:50:443
3807637996243,12cyclictest0-21swapper/308:45:353
3807637996243,12cyclictest0-21swapper/308:45:353
3807636996232,23cyclictest3815760-21perl07:30:362
380763599623,21cyclictest3810083-21fschecks_time07:15:331
3807634996248,10cyclictest0-21swapper/010:15:160
3807637996142,13cyclictest461ktimers/307:30:533
3807637996133,19cyclictest3816815-21kworker/u16:9+xprtiod08:00:283
3807637996133,19cyclictest3816815-21kworker/u16:9+xprtiod08:00:283
3807637996127,27cyclictest0-21swapper/310:10:083
380763799612,55cyclictest3836773-21ntpq08:25:483
3807634996145,12cyclictest0-21swapper/011:30:390
3807634996145,12cyclictest0-21swapper/011:30:390
3807634996141,16cyclictest0-21swapper/007:55:320
3807634996140,18cyclictest171ktimers/008:10:100
3807634996140,18cyclictest171ktimers/008:10:100
3807637996035,17cyclictest0-21swapper/307:35:353
3807637996034,17cyclictest0-21swapper/308:10:363
3807637996034,17cyclictest0-21swapper/308:10:363
3807637996025,14cyclictest3868587-21ntpq09:30:533
380763599602,46cyclictest3842349-21sh08:40:561
3807634996049,6cyclictest0-21swapper/008:25:150
3807637995949,7cyclictest0-21swapper/312:26:013
3807637995938,11cyclictest0-21swapper/310:30:313
3807636995937,18cyclictest3807866-21sshd-session07:10:162
3807634995941,13cyclictest171ktimers/007:45:190
3807634995941,13cyclictest171ktimers/007:45:190
380763799570,51cyclictest3987587-21ssh12:15:213
3807637995636,17cyclictest0-21swapper/307:15:363
3807637995611,11cyclictest45-21rcuc/307:11:083
3807635995633,11cyclictest0-21swapper/108:14:591
3807635995633,11cyclictest0-21swapper/108:14:591
3807634995637,16cyclictest0-21swapper/009:00:520
3807634995628,18cyclictest171ktimers/008:50:460
380763799551,18cyclictest3823730-21ntpq07:50:583
3807634995527,18cyclictest171ktimers/009:05:120
380763499551,46cyclictest3886922-21ssh09:55:590
3807635995430,17cyclictest0-21swapper/107:30:111
3807637995331,16cyclictest0-21swapper/308:06:023
3807635995236,13cyclictest0-21swapper/107:09:581
3807635995137,10cyclictest0-21swapper/108:45:351
3807635995137,10cyclictest0-21swapper/108:45:351
3807634994422,12cyclictest21-21rcuc/007:09:590
3807636994027,10cyclictest0-21swapper/207:09:592
380763799371,27cyclictest3807737-21latency_hist07:09:583
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional