You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-10 - 09:07
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Sat Jan 10, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28531922700,1sleep70-21swapper/721:18:237
2588374996054,5cyclictest650-21systemd-journal22:53:067
258808325949,7sleep60-21swapper/619:08:036
258798125421,29sleep70-21swapper/719:06:367
258791224319,8sleep40-21swapper/419:05:364
2588369994139,2cyclictest2959248-21kworker/u16:1+events_unbound22:12:345
2588369993937,2cyclictest3032079-21kworker/u16:1+events_unbound22:34:395
2588369993937,2cyclictest3032079-21kworker/u16:1+events_unbound22:34:395
2588369993937,2cyclictest2959248-21kworker/u16:1+events_unbound22:14:575
2588369993937,2cyclictest2861361-21kworker/u16:4+events_unbound21:27:535
2588369993936,2cyclictest2959248-21kworker/u16:1+events_unbound22:18:105
2588365993937,2cyclictest3032079-21kworker/u16:1+flush-8:022:43:064
2588369993836,2cyclictest2849169-21kworker/u16:1+events_unbound21:31:385
258837499370,35cyclictest3007842-21cut22:23:067
2588369993735,2cyclictest3264129-21kworker/u16:0+events_unbound00:27:425
2588369993735,2cyclictest3191371-21kworker/u16:0+events_unbound23:44:335
2588369993634,2cyclictest3117739-21kworker/u16:1+events_unbound23:27:545
2588369993533,2cyclictest3212854-21kworker/u16:2+events_unbound00:19:105
2588369993533,2cyclictest2995994-21kworker/u16:4+events_unbound22:28:475
2588369993432,2cyclictest3212854-21kworker/u16:2+events_unbound00:01:255
2588369993432,2cyclictest3212854-21kworker/u16:2+events_unbound00:01:255
2588369993432,2cyclictest3081082-21kworker/u16:5+events_unbound23:07:375
2588369993432,2cyclictest2861361-21kworker/u16:4+events_unbound21:43:455
2588369993432,2cyclictest2795876-21kworker/u16:0+flush-8:022:38:375
2588374993327,5cyclictest3117699-21latency_hist23:08:077
2588369993331,2cyclictest3212854-21kworker/u16:2+events_unbound00:10:385
2588369993331,2cyclictest3068879-21kworker/u16:4+events_unbound23:00:115
2588369993331,2cyclictest2795876-21kworker/u16:0+events_unbound21:09:195
2588369993330,2cyclictest2849169-21kworker/u16:1+events_unbound21:53:075
2588369993330,2cyclictest2849169-21kworker/u16:1+events_unbound21:53:075
2588365993331,2cyclictest3117739-21kworker/u16:1+events_unbound23:38:064
2588365993331,2cyclictest2861361-21kworker/u16:4+flush-8:021:34:184
258808023322,8sleep50-21swapper/519:08:025
2588369993230,2cyclictest2922544-21kworker/u16:2+events_unbound22:05:265
2588369993230,2cyclictest2815274-21kworker/u16:3+events_unbound21:21:555
2588365993230,2cyclictest2688922-21kworker/u16:5+events_unbound20:10:064
2588369993129,2cyclictest3191371-21kworker/u16:0+events_unbound23:55:415
2588369993129,2cyclictest3081082-21kworker/u16:5+events_unbound23:21:255
2588369993129,2cyclictest2679255-21kworker/u16:1+events_unbound20:29:075
2588374993029,0cyclictest0-21swapper/723:28:207
2588374993028,1cyclictest3302063-21ssh00:23:197
2588374993025,4cyclictest3190947-21latency_hist23:38:067
2588369993028,2cyclictest3068879-21kworker/u16:4+events_unbound23:37:095
2588369993028,2cyclictest2922544-21kworker/u16:2+events_unbound22:53:055
2588369993028,2cyclictest2849169-21kworker/u16:1+events_unbound21:50:295
2588365993028,2cyclictest3117739-21kworker/u16:1+events_unbound23:08:494
2588369992927,2cyclictest3103392-21kworker/u16:0+events_unbound23:09:245
2588369992927,2cyclictest3068879-21kworker/u16:4+events_unbound22:56:445
2588369992927,2cyclictest2995994-21kworker/u16:4+events_unbound22:25:405
2588369992927,2cyclictest2922544-21kworker/u16:2+flush-8:021:58:415
2588369992927,2cyclictest2922544-21kworker/u16:2+events_unbound22:45:535
2588369992927,2cyclictest2814936-21kworker/u16:2+events_unbound21:05:135
2588369992927,2cyclictest2795876-21kworker/u16:0+events_unbound21:40:125
2588369992927,2cyclictest2795876-21kworker/u16:0+events_unbound21:02:075
2588365992927,2cyclictest3117739-21kworker/u16:1+flush-8:023:43:454
2588365992927,2cyclictest2775819-21kworker/u16:4+events_unbound20:41:464
258837499280,26cyclictest2727773-21latency_hist20:18:067
2588369992826,2cyclictest3309760-21kworker/u16:3+flush-8:000:34:015
2588369992826,2cyclictest3264129-21kworker/u16:0+events_unbound00:17:395
2588369992826,2cyclictest3068879-21kworker/u16:4+events_unbound23:30:395
2588369992826,2cyclictest2679255-21kworker/u16:1+events_unbound20:43:105
2588369992826,2cyclictest2515088-21kworker/u16:2+flush-8:019:13:465
2588369992725,2cyclictest2861361-21kworker/u16:4+events_unbound21:35:565
2588369992725,2cyclictest2688922-21kworker/u16:5+events_unbound20:35:175
2588369992725,2cyclictest2688922-21kworker/u16:5+events_unbound20:15:195
2588369992725,2cyclictest2679255-21kworker/u16:1+flush-8:020:23:375
2588369992725,2cyclictest2542566-21kworker/u16:0+flush-8:019:34:185
2588365992725,2cyclictest3191371-21kworker/u16:0+flush-8:023:49:064
2588365992725,2cyclictest2922544-21kworker/u16:2+events_unbound22:08:514
2588365992725,2cyclictest2775819-21kworker/u16:4+events_unbound20:46:414
2588365992725,2cyclictest2688922-21kworker/u16:5+events_unbound20:37:304
29339832260,1chrt2933981-21ssh21:52:297
2588374992626,0cyclictest0-21swapper/722:23:377
2588374992620,5cyclictest650-21systemd-journal21:43:017
258837499260,24cyclictest3191953-21ssh23:38:187
2588369992624,2cyclictest3212854-21kworker/u16:2+events_unbound23:48:355
2588369992624,2cyclictest2542566-21kworker/u16:0+events_unbound19:27:225
2588365992624,2cyclictest3068827-21kworker/u16:3+events_unbound22:53:584
2588365992624,2cyclictest2814936-21kworker/u16:2+events_unbound21:03:414
2588365992624,2cyclictest2775819-21kworker/u16:4+events_unbound21:01:344
2588365992624,2cyclictest2679255-21kworker/u16:1+events_unbound20:51:464
2588365992624,2cyclictest2542566-21kworker/u16:0+events_unbound20:05:304
2588365992624,2cyclictest2515088-21kworker/u16:2+events_unbound19:12:274
2588369992523,2cyclictest3068879-21kworker/u16:4+flush-8:023:38:505
2588369992523,2cyclictest2775819-21kworker/u16:4+events_unbound20:54:185
2588369992523,2cyclictest2679255-21kworker/u16:1+flush-8:020:48:505
2588369992523,2cyclictest2642329-21kworker/u16:1+flush-8:019:38:175
2588369992523,2cyclictest2610429-21kworker/u16:4+flush-8:019:30:225
2588365992523,2cyclictest3264129-21kworker/u16:0+flush-8:000:08:424
2588365992523,2cyclictest3212854-21kworker/u16:2+flush-8:000:13:384
2588365992523,2cyclictest3081082-21kworker/u16:5+flush-8:022:58:494
2588365992523,2cyclictest3068827-21kworker/u16:3+events_unbound22:49:034
2588365992523,2cyclictest2610429-21kworker/u16:4+events_unbound19:25:274
2588365992523,2cyclictest2542566-21kworker/u16:0+events_unbound20:01:144
2588365992523,2cyclictest2542566-21kworker/u16:0+events_unbound19:28:544
2588369992422,2cyclictest2775819-21kworker/u16:4+events_unbound20:41:305
2588369992422,2cyclictest2586486-21kworker/u16:1+events_unbound19:09:535
2588365992422,2cyclictest2688922-21kworker/u16:5+events_unbound20:22:234
2588365992422,2cyclictest2642329-21kworker/u16:1+events_unbound19:37:144
258837499230,22cyclictest2958829-21latency_hist22:03:067
2588369992321,2cyclictest3264129-21kworker/u16:0+flush-8:000:28:385
2588369992321,2cyclictest2795876-21kworker/u16:0+events_unbound21:13:455
2588369992321,2cyclictest2610429-21kworker/u16:4+events_unbound19:19:155
2588369992321,2cyclictest2542566-21kworker/u16:0+events_unbound19:49:115
2588369992321,2cyclictest2515088-21kworker/u16:2+events_unbound20:21:185
2588369992321,2cyclictest2515088-21kworker/u16:2+events_unbound19:44:465
2588365992321,2cyclictest3191371-21kworker/u16:0+flush-8:023:38:374
2588365992321,2cyclictest3068879-21kworker/u16:4+flush-8:023:28:384
2588365992321,2cyclictest3032079-21kworker/u16:1+flush-8:022:37:014
2588365992321,2cyclictest3032079-21kworker/u16:1+flush-8:022:37:014
2588365992321,2cyclictest2861361-21kworker/u16:4+flush-8:021:58:374
2588365992321,2cyclictest2849169-21kworker/u16:1+events_unbound21:54:044
2588365992321,2cyclictest2849169-21kworker/u16:1+events_unbound21:54:044
2588365992321,2cyclictest2795876-21kworker/u16:0+flush-8:022:28:534
2588365992321,2cyclictest2737377-21kworker/u16:0+events_unbound20:27:204
2588365992321,2cyclictest2688922-21kworker/u16:5+events_unbound20:32:254
2588365992321,2cyclictest2659489-21kworker/u16:3+events_unbound19:47:554
2588365992321,2cyclictest2542566-21kworker/u16:0+events_unbound19:51:144
2588365992321,2cyclictest2515088-21kworker/u16:2+events_unbound19:19:274
2588369992220,2cyclictest2679255-21kworker/u16:1+events_unbound20:08:095
2588369992220,2cyclictest2542566-21kworker/u16:0+events_unbound19:55:215
2588365992220,2cyclictest3081082-21kworker/u16:5+flush-8:023:19:044
2588365992220,2cyclictest2688922-21kworker/u16:5+events_unbound20:17:204
2588365992220,2cyclictest2542566-21kworker/u16:0+events_unbound19:56:024
2588374992120,0cyclictest0-21swapper/723:18:187
2588374992115,5cyclictest2897765-21latency_hist21:38:077
2588365992119,2cyclictest2659489-21kworker/u16:3+events_unbound19:39:544
2588374992019,0cyclictest0-21swapper/721:28:347
2588374992017,2cyclictest3252343-21ssh00:03:107
2588365992018,2cyclictest2959248-21kworker/u16:1+events_unbound22:13:134
2588374991917,1cyclictest96-21ksoftirqd/722:13:197
2588374991911,7cyclictest1267-21snmpd23:53:467
258837499190,17cyclictest1267-21snmpd20:54:507
2588369991917,2cyclictest2679255-21kworker/u16:1+events_unbound20:05:465
2588369991916,2cyclictest3117739-21kworker/u16:1+flush-8:023:13:125
2588365991917,2cyclictest3309760-21kworker/u16:3+flush-8:000:33:524
2588365991917,2cyclictest3309760-21kworker/u16:3+flush-8:000:28:434
2588365991917,2cyclictest3068879-21kworker/u16:4+events_unbound23:03:074
2588365991917,2cyclictest2922544-21kworker/u16:2+flush-8:022:23:404
2588374991817,0cyclictest0-21swapper/719:43:307
2588374991815,2cyclictest1267-21snmpd00:08:467
2588365991815,2cyclictest2795876-21kworker/u16:0+flush-8:021:38:174
2588374991713,3cyclictest1267-21snmpd19:18:027
2588374991711,5cyclictest3142089-21latency_hist23:18:067
2588374991711,5cyclictest2824596-21latency_hist21:08:067
258837199171,15cyclictest0-21swapper/619:23:296
2588369991715,2cyclictest2542566-21kworker/u16:0+events_unbound19:59:215
2588365991715,2cyclictest2795876-21kworker/u16:0+events_unbound20:57:084
2588374991613,2cyclictest1267-21snmpd21:14:237
2588374991612,3cyclictest1267-21snmpd20:40:017
30615592150,1sleep6841rcuc/622:43:256
258837499156,8cyclictest0-21swapper/722:58:307
258837499156,7cyclictest0-21swapper/722:33:287
258837499156,7cyclictest0-21swapper/722:33:287
258837499156,7cyclictest0-21swapper/722:28:207
258837499156,7cyclictest0-21swapper/721:23:187
2588371991510,1cyclictest0-21swapper/621:49:376
258837199150,7cyclictest0-21swapper/621:23:206
258837199150,1cyclictest0-21swapper/620:08:256
2588365991513,2cyclictest2849169-21kworker/u16:1+flush-8:021:53:064
258837499147,6cyclictest0-21swapper/722:08:187
258837499147,6cyclictest0-21swapper/700:13:277
258837499146,7cyclictest0-21swapper/723:53:017
258837499146,7cyclictest0-21swapper/721:08:297
258837499145,8cyclictest0-21swapper/700:22:057
2588374991411,2cyclictest2756752-21munin-run20:33:067
258837499140,1cyclictest0-21swapper/719:38:297
258837499140,13cyclictest0-21swapper/722:38:307
2588371991413,1cyclictest0-21swapper/622:32:496
2588371991412,2cyclictest3276797-21kworker/u16:1+events_unbound00:18:316
2588371991412,2cyclictest0-21swapper/621:56:436
2588371991412,2cyclictest0-21swapper/621:56:436
258837199140,1cyclictest0-21swapper/622:57:256
258837199140,14cyclictest0-21swapper/600:25:046
2588365991413,1cyclictest0-21swapper/423:17:424
2588365991413,1cyclictest0-21swapper/421:43:454
2588365991411,2cyclictest3212854-21kworker/u16:2+events_unbound00:03:214
2588365991411,2cyclictest2922544-21kworker/u16:2+events_unbound22:43:134
258836599140,14cyclictest0-21swapper/423:26:424
258836599140,14cyclictest0-21swapper/421:17:164
258837499139,3cyclictest1267-21snmpd23:43:487
258837499138,4cyclictest2785802-21latency_hist20:48:077
258837499136,6cyclictest0-21swapper/723:24:337
258837499136,6cyclictest0-21swapper/722:53:317
258837499136,6cyclictest0-21swapper/721:43:187
258837499136,6cyclictest0-21swapper/700:34:297
258837499136,6cyclictest0-21swapper/700:28:097
258837499135,7cyclictest0-21swapper/723:58:207
258837499135,7cyclictest0-21swapper/723:58:207
258837499135,7cyclictest0-21swapper/723:08:307
258837499134,8cyclictest0-21swapper/720:35:037
2588374991312,0cyclictest0-21swapper/719:58:217
2588374991310,2cyclictest2596989-21ntpq19:08:327
258837499130,5cyclictest2964973-21ssh22:03:257
258837499130,2cyclictest0-21swapper/722:43:297
258837499130,11cyclictest2612934-21irqcore19:18:217
2588371991312,1cyclictest0-21swapper/623:53:516
2588371991312,1cyclictest0-21swapper/623:23:356
2588371991312,1cyclictest0-21swapper/622:12:386
2588371991312,1cyclictest0-21swapper/620:22:086
2588371991310,1cyclictest0-21swapper/622:14:236
2588371991310,1cyclictest0-21swapper/620:46:346
258837199130,13cyclictest0-21swapper/622:40:236
258837199130,13cyclictest0-21swapper/621:16:036
2588365991312,1cyclictest0-21swapper/423:56:294
2588365991312,1cyclictest0-21swapper/421:31:364
2588365991312,1cyclictest0-21swapper/421:22:374
2588365991311,2cyclictest3276797-21kworker/u16:1+events_unbound00:28:004
2588365991311,2cyclictest2795876-21kworker/u16:0+events_unbound21:23:194
258836599130,13cyclictest0-21swapper/423:58:324
258836599130,13cyclictest0-21swapper/423:58:324
258836599130,13cyclictest0-21swapper/400:19:124
25938352120,1sleep60-21swapper/619:08:266
258837499128,3cyclictest1267-21snmpd20:08:197
258837499128,3cyclictest1267-21snmpd19:53:157
258837499128,3cyclictest1267-21snmpd19:35:457
258837499124,7cyclictest0-21swapper/721:53:217
258837499124,7cyclictest0-21swapper/721:53:217
258837499120,5cyclictest2739039-21kthreadcore20:23:247
258837499120,2cyclictest0-21swapper/720:58:307
2588371991211,1cyclictest0-21swapper/623:45:306
2588371991211,1cyclictest0-21swapper/623:21:236
2588371991211,1cyclictest0-21swapper/622:51:446
2588371991211,1cyclictest0-21swapper/622:25:156
2588371991211,1cyclictest0-21swapper/622:07:176
2588371991211,1cyclictest0-21swapper/621:44:256
2588371991211,1cyclictest0-21swapper/620:59:396
2588371991211,1cyclictest0-21swapper/620:24:016
258837199120,0cyclictest0-21swapper/600:37:316
2588369991211,1cyclictest0-21swapper/500:07:325
2588365991211,1cyclictest0-21swapper/422:06:274
2588365991210,2cyclictest2922544-21kworker/u16:2+flush-8:022:18:324
258837499117,3cyclictest1267-21snmpd20:03:157
258837499116,4cyclictest1267-21snmpd19:48:217
258837499114,5cyclictest5944-21gmain19:23:457
258837499110,2cyclictest0-21swapper/720:18:197
258837499110,10cyclictest2789063-21kthreadcore20:48:247
2588371991110,1cyclictest0-21swapper/623:51:486
2588371991110,1cyclictest0-21swapper/623:30:226
2588371991110,1cyclictest0-21swapper/623:03:056
2588371991110,1cyclictest0-21swapper/622:21:386
2588371991110,1cyclictest0-21swapper/621:39:136
2588371991110,1cyclictest0-21swapper/621:30:236
2588371991110,1cyclictest0-21swapper/620:39:006
2588371991110,1cyclictest0-21swapper/620:33:196
2588371991110,1cyclictest0-21swapper/600:29:106
2588371991110,1cyclictest0-21swapper/600:14:406
258837199110,11cyclictest0-21swapper/619:58:486
258837199110,11cyclictest0-21swapper/619:17:106
2588365991110,1cyclictest0-21swapper/421:11:544
258836599110,11cyclictest0-21swapper/419:15:434
258837499106,3cyclictest1267-21snmpd19:28:367
258837199109,1cyclictest0-21swapper/621:34:016
258837199109,1cyclictest0-21swapper/621:05:106
258837199109,1cyclictest0-21swapper/619:53:076
258837199107,2cyclictest2658809-21ntpq19:38:276
25883719998,1cyclictest0-21swapper/622:01:556
25883719998,1cyclictest0-21swapper/620:53:586
25883719998,1cyclictest0-21swapper/600:12:376
25883719996,2cyclictest2660182-21/usr/sbin/munin19:43:296
25883719996,2cyclictest0-21swapper/623:33:226
25883719996,2cyclictest0-21swapper/619:28:246
25883719987,1cyclictest0-21swapper/623:16:486
25883719987,1cyclictest0-21swapper/620:04:286
25883719987,1cyclictest0-21swapper/600:04:166
25883719986,1cyclictest0-21swapper/620:28:216
25883719985,2cyclictest3192114-21fschecks_time23:38:196
25883719985,2cyclictest0-21swapper/622:33:266
25883719985,2cyclictest0-21swapper/622:33:266
25883719984,3cyclictest2723579-21cut20:13:256
25883719983,4cyclictest3122398-21tr23:08:246
25883719983,4cyclictest2825824-21fw_packets21:08:206
25883719983,4cyclictest2643203-21cut19:33:236
25883719982,1cyclictest28502042gltestperf21:18:196
25883719975,1cyclictest2786356-21cpuspeed_turbos20:48:186
25883719975,1cyclictest0-21swapper/619:18:216
25883719973,3cyclictest3241000-21cat23:58:216
25883719973,3cyclictest3241000-21cat23:58:216
25883719973,3cyclictest2672198-21tr19:48:246
25883719972,4cyclictest3107673-21kthreadcore23:03:226
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional