You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-25 - 11:58
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack8slot2.osadl.org (updated Thu Jun 25, 2026 00:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28679339916355,105cyclictest171ktimers/020:45:170
2867933991611,136cyclictest3051699-21ntpq00:26:040
286793399160151,7cyclictest171ktimers/023:25:160
286793399160151,7cyclictest171ktimers/023:25:160
2867933991441,95cyclictest16-21ksoftirqd/022:15:180
2867936991345,32cyclictest45-21rcuc/321:35:593
2867936991345,32cyclictest45-21rcuc/321:35:593
286793599134123,4cyclictest2938171-21aten_r8power_fr21:45:472
28679359913010,28cyclictest2968247-21kworker/u16:6+rpciod23:19:582
286793699127109,13cyclictest81-21hwrng19:24:293
286793699127109,13cyclictest81-21hwrng19:24:293
28679359912560,50cyclictest0-21swapper/223:20:382
2867935991251,49cyclictest2913350-21aten_r8power_fr21:10:262
286793499125108,13cyclictest81-21hwrng00:36:481
286793499125108,13cyclictest81-21hwrng00:36:481
286793499124114,6cyclictest81-21hwrng00:04:021
28679349912353,12cyclictest10650irq/205-8000000.ethernet-rx022:41:071
28679349912353,12cyclictest10650irq/205-8000000.ethernet-rx022:41:071
28679359912283,30cyclictest81-21hwrng23:46:382
2867933991221,28cyclictest2651749-21kworker/u16:0+rpciod19:19:590
286793399122105,13cyclictest81-21hwrng21:42:430
286793699121112,5cyclictest81-21hwrng20:58:413
286793699121112,5cyclictest81-21hwrng20:58:413
286793699121111,7cyclictest81-21hwrng19:36:463
286793499121112,5cyclictest81-21hwrng22:11:241
286793499121112,5cyclictest81-21hwrng22:11:241
286793499119110,6cyclictest81-21hwrng21:19:101
286793499118109,5cyclictest81-21hwrng23:01:341
286793499118102,13cyclictest81-21hwrng19:38:491
286793699117103,11cyclictest81-21hwrng21:03:493
286793699117103,11cyclictest81-21hwrng21:03:493
286793599117108,5cyclictest81-21hwrng19:23:282
286793599117108,5cyclictest81-21hwrng19:23:282
286793699116100,13cyclictest81-21hwrng19:18:203
286793699115107,6cyclictest81-21hwrng23:51:453
286793699115104,7cyclictest81-21hwrng20:23:533
2867933991153,83cyclictest2941470-21aten_r8power_cu21:50:260
2867933991153,83cyclictest2941470-21aten_r8power_cu21:50:260
286793499113103,6cyclictest81-21hwrng23:06:411
286793699112104,5cyclictest81-21hwrng19:57:153
286793699112103,5cyclictest81-21hwrng22:47:143
286793599112103,6cyclictest81-21hwrng23:41:302
28679349911297,12cyclictest81-21hwrng00:10:111
28679339911236,68cyclictest0-21swapper/023:16:040
28679359911195,5cyclictest81-21hwrng23:50:432
286793599111103,5cyclictest81-21hwrng21:18:092
28679359911035,22cyclictest2888282-21kworker/u16:20+rpciod20:40:302
28679339911037,27cyclictest2909100-21sendmail-msp21:00:380
28679339911037,27cyclictest2909100-21sendmail-msp21:00:380
28679359910992,14cyclictest81-21hwrng23:12:502
28679359910992,14cyclictest81-21hwrng23:12:502
286793599109100,6cyclictest81-21hwrng23:55:512
286793499109100,6cyclictest81-21hwrng22:46:131
28679339910961,45cyclictest171ktimers/020:30:470
2867933991091,21cyclictest2903246-21kworker/u16:3+rpciod20:59:580
2867933991091,21cyclictest2903246-21kworker/u16:3+rpciod20:59:580
286793699108100,5cyclictest81-21hwrng20:37:113
286793699108100,5cyclictest81-21hwrng20:37:113
2867934991085,101cyclictest0-21swapper/119:40:361
28679339910852,49cyclictest171ktimers/021:05:060
28679369910798,6cyclictest81-21hwrng20:33:053
28679369910793,5cyclictest81-21hwrng20:18:453
28679369910793,5cyclictest81-21hwrng20:18:453
28679369910793,11cyclictest81-21hwrng19:12:123
28679349910797,7cyclictest81-21hwrng21:53:591
28679349910797,7cyclictest81-21hwrng21:53:591
28679349910791,11cyclictest81-21hwrng21:48:521
2867934991077,50cyclictest2935115-21cat21:40:441
28679359910698,5cyclictest81-21hwrng00:26:342
28679339910697,6cyclictest0-21swapper/023:30:440
28679369910595,5cyclictest81-21hwrng20:26:573
28679359910547,54cyclictest0-21swapper/223:33:542
28679349910569,31cyclictest0-21swapper/123:40:151
28679349910515,17cyclictest2969511-21apt-get22:30:221
28679339910591,11cyclictest81-21hwrng21:14:030
28679339910564,39cyclictest171ktimers/021:15:460
28679369910498,4cyclictest81-21hwrng20:04:253
28679359910490,11cyclictest81-21hwrng19:29:362
28679359910431,30cyclictest2927360-21ssh21:30:202
28679349910489,7cyclictest81-21hwrng20:41:171
28679349910488,12cyclictest81-21hwrng19:27:331
28679339910486,13cyclictest81-21hwrng22:35:580
28679349910391,9cyclictest81-21hwrng19:55:121
28679349910388,5cyclictest81-21hwrng21:24:171
28679349910289,9cyclictest81-21hwrng20:10:341
28679349910268,20cyclictest301ktimers/123:10:581
28679349910268,20cyclictest301ktimers/123:10:581
28679349910123,50cyclictest2867932-21cyclictest23:20:581
28679339910138,60cyclictest0-21swapper/022:05:300
28679349910092,6cyclictest81-21hwrng21:34:321
2867935999992,4cyclictest81-21hwrng19:35:452
2867935999982,13cyclictest3006650-21kworker/u16:19+rpciod23:39:572
2867933999968,29cyclictest10650irq/205-8000000.ethernet-rx023:40:320
2867935999890,5cyclictest81-21hwrng22:29:502
2867934999890,5cyclictest81-21hwrng00:30:401
2867935999788,5cyclictest81-21hwrng21:59:062
2867935999788,5cyclictest81-21hwrng21:59:062
2867933999736,13cyclictest0-21swapper/023:39:590
2867935999630,23cyclictest3028079-21kworker/u16:9+rpciod00:10:242
2867934999650,11cyclictest0-21swapper/123:25:241
2867934999650,11cyclictest0-21swapper/123:25:241
2867933999692,2cyclictest0-21swapper/021:20:180
2867934999580,10cyclictest81-21hwrng19:45:591
2867933999586,5cyclictest81-21hwrng22:34:570
2867933999542,11cyclictest0-21swapper/021:30:100
2867933999540,48cyclictest0-21swapper/000:01:200
2867933999532,14cyclictest171ktimers/020:10:120
2867935999486,5cyclictest81-21hwrng21:28:232
2867935999486,5cyclictest81-21hwrng21:28:232
286793499945,75cyclictest3015595-21/usr/sbin/munin23:35:271
2867933999485,6cyclictest81-21hwrng19:28:350
2867933999478,12cyclictest81-21hwrng23:54:490
2867933999443,44cyclictest0-21swapper/021:25:310
2867933999443,44cyclictest0-21swapper/021:25:310
2867933999437,43cyclictest0-21swapper/023:55:310
286793399941,5cyclictest3059824-21kworker/u16:9+rpciod00:39:580
286793399941,5cyclictest3059824-21kworker/u16:9+rpciod00:39:580
2867936999384,6cyclictest81-21hwrng19:34:433
2867936999366,14cyclictest0-21swapper/321:15:433
2867935999330,29cyclictest2631935-21kworker/u16:7+rpciod21:40:442
2867933999342,48cyclictest10450irq/163-8000000.ethernet-tx600:15:530
2867936999263,24cyclictest0-21swapper/321:30:193
2867934999269,19cyclictest0-21swapper/100:20:231
286793399925,56cyclictest2994766-21idleruntime23:05:330
2867933999233,16cyclictest0-21swapper/000:20:470
2867936999185,3cyclictest2976313-21sendmail-msp22:40:393
2867936999185,3cyclictest2976313-21sendmail-msp22:40:393
2867935999184,5cyclictest81-21hwrng19:49:042
2867935999180,7cyclictest81-21hwrng19:15:162
2867933999135,45cyclictest0-21swapper/022:40:370
2867933999135,45cyclictest0-21swapper/022:40:370
286793399912,48cyclictest2967068-21ssh22:25:540
286793599908,61cyclictest39-21ksoftirqd/220:45:172
2867934999081,6cyclictest81-21hwrng00:05:041
2867933999041,46cyclictest171ktimers/019:35:200
2867933999033,15cyclictest171ktimers/021:55:130
2867933999033,15cyclictest171ktimers/021:55:130
286793699893,81cyclictest2921452-21ntpq21:21:093
2867935998977,8cyclictest81-21hwrng22:07:182
2867935998950,23cyclictest651-21containerd23:27:052
2867935998950,23cyclictest651-21containerd23:27:052
286793499898,69cyclictest2930808-21apt-get21:35:191
286793499898,69cyclictest2930808-21apt-get21:35:191
2867933998933,17cyclictest0-21swapper/020:00:410
2867933998929,18cyclictest0-21swapper/020:21:130
2867935998879,6cyclictest81-21hwrng22:23:412
2867935998834,26cyclictest2968245-21kworker/u16:0+rpciod23:00:132
2867935998830,11cyclictest0-21swapper/200:39:592
2867935998830,11cyclictest0-21swapper/200:39:592
2867933998821,26cyclictest2912839-21diskmemload00:10:130
2867936998782,3cyclictest10650irq/205-8000000.ethernet-rx023:20:193
2867936998779,6cyclictest461ktimers/320:10:413
2867933998738,17cyclictest171ktimers/000:31:030
2867936998679,4cyclictest81-21hwrng22:50:183
2867936998679,4cyclictest2934058-21sendmail-msp21:40:403
2867936998647,34cyclictest0-21swapper/300:20:393
2867934998678,5cyclictest81-21hwrng22:26:451
2867933998676,7cyclictest81-21hwrng00:09:090
2867933998640,36cyclictest0-21swapper/020:51:190
2867933998635,16cyclictest3023445-21ntp_states23:46:000
2867933998632,16cyclictest0-21swapper/022:00:260
2867935998544,35cyclictest292849550kworker/u16:2+xprtiod21:35:212
2867935998544,35cyclictest292849550kworker/u16:2+xprtiod21:35:212
2867934998577,5cyclictest81-21hwrng22:53:231
2867933998561,20cyclictest171ktimers/021:46:100
2867933998538,10cyclictest0-21swapper/020:25:310
2867933998528,54cyclictest2912839-21diskmemload23:20:320
286793699841,72cyclictest651-21containerd23:35:133
2867933998431,19cyclictest2981920-21ssh22:46:360
2867933998427,18cyclictest2871693-21sendmail-msp19:20:390
2867933998427,18cyclictest2871693-21sendmail-msp19:20:390
2867935998365,14cyclictest0-21swapper/200:00:412
2867933998334,16cyclictest0-21swapper/023:00:100
2867936998275,5cyclictest10650irq/205-8000000.ethernet-rx021:49:563
2867936998264,16cyclictest45-21rcuc/322:10:193
2867936998264,16cyclictest45-21rcuc/322:10:193
286793599822,39cyclictest2973042-21ssh22:35:062
2867934998215,59cyclictest29-21rcuc/121:55:211
2867934998215,59cyclictest29-21rcuc/121:55:211
2867933998246,32cyclictest0-21swapper/021:35:470
2867933998246,32cyclictest0-21swapper/021:35:470
286793399822,26cyclictest2987644-21grep22:55:330
286793399822,26cyclictest2987644-21grep22:55:330
2867936998154,16cyclictest0-21swapper/323:10:503
2867936998154,16cyclictest0-21swapper/323:10:503
2867935998171,6cyclictest81-21hwrng19:11:102
2867936998064,12cyclictest0-21swapper/300:30:353
286793699805,70cyclictest56-21kcompactd023:40:563
2867935998071,6cyclictest81-21hwrng20:52:332
2867935998067,10cyclictest81-21hwrng20:36:102
2867935998067,10cyclictest81-21hwrng20:36:102
2867934998072,5cyclictest81-21hwrng20:22:511
2867934998013,55cyclictest29-21rcuc/120:50:591
2867933998032,13cyclictest0-21swapper/019:44:570
2867936997971,5cyclictest81-21hwrng20:54:363
2867935997970,6cyclictest81-21hwrng22:00:082
2867933997936,10cyclictest0-21swapper/019:50:310
286793699787,57cyclictest3058662-21ssh00:35:553
286793699787,57cyclictest3058662-21ssh00:35:553
2867936997871,4cyclictest2991680-21ntpq23:00:573
2867936997854,19cyclictest461ktimers/322:35:233
2867936997851,22cyclictest0-21swapper/323:55:403
2867935997851,24cyclictest3055731-21/usr/sbin/munin00:31:122
2867934997857,17cyclictest2855826-21kworker/u16:14+rpciod20:00:141
2867933997826,19cyclictest2890004-21unixbench_multi20:06:030
286793399781,44cyclictest2998615-21ssh23:10:450
286793399781,44cyclictest2998615-21ssh23:10:450
286793699776,53cyclictest2988000-21ssh22:55:403
286793699776,53cyclictest2988000-21ssh22:55:403
2867936997746,24cyclictest0-21swapper/321:50:083
2867936997746,24cyclictest0-21swapper/321:50:083
286793699771,63cyclictest2996350-21kworker/u16:7+xprtiod00:00:393
2867935997737,37cyclictest0-21swapper/222:45:322
2867936997669,4cyclictest3002409-21/usr/sbin/munin23:16:043
2867936997663,9cyclictest0-21swapper/322:00:123
2867936997647,19cyclictest461ktimers/322:20:243
2867934997650,23cyclictest0-21swapper/100:25:351
2867936997535,28cyclictest3012162-21/usr/sbin/munin23:30:313
2867934997558,11cyclictest0-21swapper/121:05:301
2867934997549,13cyclictest301ktimers/120:05:101
286793399755,44cyclictest2962661-21head22:20:290
2867933997552,16cyclictest171ktimers/022:10:110
2867933997552,16cyclictest171ktimers/022:10:110
2867933997526,23cyclictest2900802-21ntpq20:35:510
2867933997526,23cyclictest2900802-21ntpq20:35:510
2867936997463,8cyclictest461ktimers/321:55:113
2867936997463,8cyclictest461ktimers/321:55:113
2867934997465,7cyclictest81-21hwrng20:32:041
286793699734,49cyclictest2927012-21latency_hist21:29:573
286793699734,49cyclictest2927012-21latency_hist21:29:573
2867936997310,61cyclictest2952347-21tune2fs22:05:303
286793599735,52cyclictest3037559-21sh00:06:032
2867934997365,5cyclictest81-21hwrng20:47:261
2867933997343,26cyclictest0-21swapper/020:40:360
2867933997328,23cyclictest2983944-21df22:50:290
2867936997261,8cyclictest461ktimers/300:10:073
2867936997254,14cyclictest45-21rcuc/300:15:113
2867936997251,18cyclictest461ktimers/319:25:093
2867934997250,19cyclictest0-21swapper/123:54:551
286793499722,34cyclictest0-21swapper/120:39:591
286793499722,34cyclictest0-21swapper/120:39:591
2867934997144,25cyclictest0-21swapper/123:45:441
2867934997143,14cyclictest10650irq/205-8000000.ethernet-rx023:56:031
2867933997133,14cyclictest10650irq/205-8000000.ethernet-rx019:45:290
2867934997052,7cyclictest2923761-21ssh21:25:101
2867934997052,7cyclictest2923761-21ssh21:25:101
2867934997048,18cyclictest0-21swapper/122:20:401
2867934997040,27cyclictest2960868-21sleep22:16:411
2867935996933,33cyclictest0-21swapper/220:00:182
2867934996934,32cyclictest0-21swapper/122:01:151
2867935996843,20cyclictest0-21swapper/219:40:232
2867934996860,4cyclictest81-21hwrng21:04:501
2867934996860,4cyclictest81-21hwrng21:04:501
2867934996847,19cyclictest301ktimers/119:10:411
2867934996844,20cyclictest0-21swapper/123:34:571
2867936996747,18cyclictest461ktimers/322:30:203
2867936996747,15cyclictest2867932-21cyclictest19:50:113
2867936996736,23cyclictest1-21systemd19:44:383
286793699673,39cyclictest47-21ksoftirqd/323:25:263
286793699673,39cyclictest47-21ksoftirqd/323:25:263
2867935996757,7cyclictest81-21hwrng19:31:392
2867935996753,7cyclictest81-21hwrng19:56:142
2867934996759,6cyclictest81-21hwrng20:59:431
2867934996759,6cyclictest81-21hwrng20:59:431
2867936996645,17cyclictest0-21swapper/320:05:233
2867933996641,20cyclictest0-21swapper/020:16:050
2867933996641,20cyclictest0-21swapper/020:16:050
2867935996547,15cyclictest0-21swapper/200:20:322
2867934996550,11cyclictest0-21swapper/122:55:401
2867934996550,11cyclictest0-21swapper/122:55:401
2867934996542,10cyclictest0-21swapper/120:16:051
2867934996542,10cyclictest0-21swapper/120:16:051
2867936996444,16cyclictest0-21swapper/322:15:453
2867936996437,23cyclictest45-21rcuc/323:05:103
2867935996449,12cyclictest0-21swapper/222:55:312
2867935996449,12cyclictest0-21swapper/222:55:312
2867935996446,10cyclictest0-21swapper/222:10:472
2867935996446,10cyclictest0-21swapper/222:10:472
2867935996442,18cyclictest0-21swapper/200:15:262
2867935996441,19cyclictest2958992-21ssh22:15:122
2867934996441,19cyclictest0-21swapper/119:30:331
2867936996332,25cyclictest0-21swapper/323:45:103
286793699631,42cyclictest56-21kcompactd000:05:123
2867935996350,9cyclictest0-21swapper/221:20:122
2867936996249,10cyclictest461ktimers/319:45:553
2867935996230,26cyclictest2909100-21sendmail-msp21:00:412
2867935996230,26cyclictest2909100-21sendmail-msp21:00:412
2867935996229,26cyclictest2894130-21sendmail-msp20:20:412
2867934996253,7cyclictest2914835-21users21:11:101
2867934996238,11cyclictest0-21swapper/119:09:571
2867934996229,30cyclictest0-21swapper/119:20:361
2867934996229,30cyclictest0-21swapper/119:20:361
2867933996247,12cyclictest171ktimers/019:10:070
2867933996237,18cyclictest0-21swapper/019:55:310
2867936996151,8cyclictest10650irq/205-8000000.ethernet-rx021:10:433
2867935996124,32cyclictest2912839-21diskmemload21:09:572
2867936996034,21cyclictest0-21swapper/320:40:383
2867935996041,9cyclictest0-21swapper/223:05:312
2867934996030,26cyclictest2974030-21ntpq22:35:451
2867936995937,10cyclictest0-21swapper/322:29:583
2867936995936,17cyclictest0-21swapper/321:05:463
2867935995935,17cyclictest0-21swapper/222:40:052
2867935995935,17cyclictest0-21swapper/222:40:052
2867935995928,25cyclictest2889468-21ntpq20:05:372
2867935995925,28cyclictest2969568-21ssh22:30:152
2867934995945,7cyclictest301ktimers/122:05:361
2867934995945,11cyclictest0-21swapper/123:15:501
2867934995939,11cyclictest301ktimers/119:16:001
2867936995849,6cyclictest3050542-21ssh00:25:133
2867935995826,28cyclictest2983640-21ssh22:50:182
2867934995830,15cyclictest2867932-21cyclictest19:50:101
2867933995840,15cyclictest171ktimers/019:30:110
2867935995741,11cyclictest0-21swapper/220:30:332
2867935995737,15cyclictest0-21swapper/220:55:052
2867935995737,15cyclictest0-21swapper/220:55:052
2867935995733,16cyclictest381ktimers/219:50:552
2867934995741,13cyclictest0-21swapper/100:15:251
2867935995639,11cyclictest0-21swapper/220:10:322
2867935995630,23cyclictest2892727-21df20:15:282
2867935995630,23cyclictest2892727-21df20:15:282
2867935995630,22cyclictest2919097-21kworker/u16:4+xprtiod21:50:082
2867935995630,22cyclictest2919097-21kworker/u16:4+xprtiod21:50:082
2867934995636,16cyclictest0-21swapper/120:29:581
2867936995536,10cyclictest0-21swapper/320:49:583
2867935995535,12cyclictest0-21swapper/220:25:302
2867935994937,9cyclictest0-21swapper/219:09:572
2867933994726,11cyclictest0-21swapper/019:09:570
2867936994633,10cyclictest0-21swapper/319:09:583
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional