You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-24 - 05:48
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack0slot2.osadl.org (updated Wed Dec 24, 2025 00:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
40412092710,1sleep74041210-21sh19:24:147
400818125847,8sleep50-21swapper/519:08:585
3400222550,0sleep7340023-21tr23:34:377
400796425319,30sleep70-21swapper/719:05:567
400812224616,8sleep40-21swapper/419:08:094
4008500994438,5cyclictest4167051-21latency_hist20:29:137
400811524218,7sleep60-21swapper/619:08:036
4008490993735,2cyclictest4138056-21kworker/u16:0+flush-8:020:19:325
41418272360,1sleep50-21swapper/520:14:365
400850099350,34cyclictest4019508-21grep19:14:177
4008490993533,2cyclictest3741449-21kworker/u16:0+flush-8:019:24:435
4008490993533,2cyclictest254893-21kworker/u16:2+events_unbound23:44:075
4008490993533,2cyclictest177158-21kworker/u16:3+events_unbound22:39:275
4008490993533,2cyclictest156618-21kworker/u16:5+events_unbound22:54:285
4008490993432,2cyclictest371008-21kworker/u16:3+events_unbound23:54:305
4008490993331,2cyclictest177158-21kworker/u16:3+flush-8:022:29:135
4008490993331,2cyclictest156618-21kworker/u16:5+events_unbound23:04:285
4008490993331,2cyclictest156618-21kworker/u16:5+events_unbound23:04:285
4008490993230,2cyclictest41666-21kworker/u16:0+flush-8:021:04:435
4008490993229,2cyclictest4176905-21kworker/u16:2+events_unbound20:34:155
4008490993128,2cyclictest390298-21kworker/u16:1+flush-8:000:19:305
4008500993024,5cyclictest79970-21latency_hist21:24:137
4008490993028,2cyclictest41666-21kworker/u16:0+events_unbound21:34:135
4008490993028,2cyclictest41666-21kworker/u16:0+events_unbound21:34:135
4008490993028,2cyclictest371008-21kworker/u16:3+events_unbound00:34:305
4008490993027,2cyclictest41666-21kworker/u16:0+flush-8:021:19:145
4008490992927,2cyclictest80003-21kworker/u16:1+events_unbound22:04:325
4008490992926,2cyclictest69953-21kworker/u16:2+events_unbound21:24:275
4008490992826,2cyclictest3979249-21kworker/u16:3+events_unbound19:29:285
1944552280,1sleep50-21swapper/522:19:355
4008490992725,2cyclictest245020-21kworker/u16:0+events_unbound22:49:295
4008500992624,1cyclictest0-21swapper/719:09:367
4008500992624,1cyclictest0-21swapper/719:09:367
4008500992623,2cyclictest1267-21snmpd20:33:507
4008500992621,4cyclictest4108938-21latency_hist19:59:147
4008500992621,4cyclictest4108938-21latency_hist19:59:147
4008495992622,3cyclictest254893-21kworker/u16:2+flush-8:023:24:396
4008490992624,2cyclictest390298-21kworker/u16:1+events_unbound00:14:265
4008490992624,2cyclictest254893-21kworker/u16:2+flush-8:022:59:465
4008490992624,2cyclictest20958-21kworker/u16:3+events_unbound21:14:275
4346772250,1chrt741rcuc/500:24:355
412742250,1chrt41271-21crond21:04:137
4008500992524,0cyclictest0-21swapper/700:22:237
4008500992519,5cyclictest273916-21latency_hist23:04:137
4008490992523,2cyclictest4161742-21kworker/u16:1+events_unbound20:49:395
4008490992523,2cyclictest379341-21kworker/u16:4+events_unbound00:04:285
4008490992422,2cyclictest4161742-21kworker/u16:1+events_unbound21:12:315
4008490992421,2cyclictest4041396-21kworker/u16:4+events_unbound20:54:235
3857432240,1chrt0-21swapper/523:59:355
4008500992320,2cyclictest236267-21fw_packets22:44:287
4008500992317,5cyclictest4157415-21latency_hist20:24:147
4008500992317,5cyclictest293269-21latency_hist23:14:137
4008490992321,2cyclictest41666-21kworker/u16:0+events_unbound21:39:085
4008490992321,2cyclictest254893-21kworker/u16:2+events_unbound23:34:285
4008490992321,2cyclictest245020-21kworker/u16:0+events_unbound23:22:235
4008490992321,2cyclictest156618-21kworker/u16:5+events_unbound22:34:135
4008490992321,2cyclictest128462-21kworker/u16:4+events_unbound21:59:395
4008490992320,2cyclictest254893-21kworker/u16:2+flush-8:023:24:245
4008495992219,3cyclictest3741449-21kworker/u16:0+flush-8:019:34:146
4008490992221,1cyclictest4138056-21kworker/u16:0+events_unbound20:32:245
4008490992220,2cyclictest177158-21kworker/u16:3+events_unbound22:49:085
400850099210,19cyclictest400813-21df_inode00:09:277
4008490992119,2cyclictest332145-21kworker/u16:0+events_unbound23:49:255
4008500992017,2cyclictest351463-21perf23:44:127
4008495992017,2cyclictest128462-21kworker/u16:4+flush-8:021:54:316
4008490992018,2cyclictest156618-21kworker/u16:5+events_unbound23:15:585
41268382190,0sleep74126840-21kthreadcore20:04:367
4008500991918,0cyclictest0-21swapper/722:11:317
4008500991914,4cyclictest650-21systemd-journal19:49:137
4008500991914,4cyclictest12260-21latency_hist20:49:137
4008500991914,4cyclictest12260-21latency_hist20:49:137
4008495991917,2cyclictest4041396-21kworker/u16:4+flush-8:020:54:096
4008500991815,2cyclictest89657-21perf21:29:137
4008495991815,2cyclictest379341-21kworker/u16:4+events_unbound00:04:306
4008490991816,2cyclictest4041396-21kworker/u16:4+events_unbound20:28:195
4008490991816,2cyclictest3741449-21kworker/u16:0+flush-8:019:34:305
4008490991816,2cyclictest168882-21kworker/u16:2+flush-8:022:09:415
4008490991816,2cyclictest156618-21kworker/u16:5+events_unbound22:34:465
4008490991816,2cyclictest128462-21kworker/u16:4+events_unbound21:57:245
4008490991815,2cyclictest3979249-21kworker/u16:3+events_unbound20:04:155
400850099170,16cyclictest4090341-21cstates19:49:287
400850099170,15cyclictest442002-21grep00:29:317
4008495991715,2cyclictest245020-21kworker/u16:0+flush-8:023:19:446
4008490991715,2cyclictest4176905-21kworker/u16:2+events_unbound20:40:245
4008490991715,2cyclictest41666-21kworker/u16:0+events_unbound21:51:235
4008500991610,5cyclictest650-21systemd-journal20:39:137
400850099160,14cyclictest206908-21cat22:29:277
400850099159,5cyclictest70270-21latency_hist21:19:137
4008500991512,2cyclictest0-21swapper/720:54:147
400850099150,13cyclictest274812-21df23:04:267
400850099150,13cyclictest274812-21df23:04:267
4008490991513,2cyclictest3741449-21kworker/u16:0+events_unbound19:46:245
4008490991512,2cyclictest3979249-21kworker/u16:3+flush-8:019:19:245
400850099149,4cyclictest391383-21cat00:04:307
400850099141,12cyclictest137773-21users21:49:457
4008500991411,2cyclictest0-21swapper/700:24:417
4008500991410,3cyclictest4137079-21ntpq20:09:437
4008500991410,3cyclictest4050127-21smart_sda19:24:457
4008500991410,3cyclictest263260-21ntpq22:54:387
4008500991410,3cyclictest1267-21snmpd20:40:237
400850099140,12cyclictest202024-21cut22:24:347
4008495991413,1cyclictest0-21swapper/622:19:236
4008495991412,2cyclictest41666-21kworker/u16:0+flush-8:022:19:136
4008495991412,2cyclictest371008-21kworker/u16:3+flush-8:023:59:086
4008495991411,2cyclictest3741449-21kworker/u16:0+events_unbound19:14:176
400849599140,1cyclictest0-21swapper/620:54:346
4008490991412,2cyclictest3979249-21kworker/u16:3+events_unbound19:59:105
4008490991412,2cyclictest3979249-21kworker/u16:3+events_unbound19:59:105
4008490991412,2cyclictest3979249-21kworker/u16:3+events_unbound19:39:245
4008490991412,2cyclictest3741449-21kworker/u16:0+flush-8:019:14:295
4008490991412,2cyclictest3741449-21kworker/u16:0+events_unbound19:12:245
4008490991412,2cyclictest3741449-21kworker/u16:0+events_unbound19:12:245
4008490991412,2cyclictest371008-21kworker/u16:3+flush-8:000:09:335
4008490991412,2cyclictest313052-21kworker/u16:3+events_unbound23:31:285
4008490991412,2cyclictest11939-21kworker/u16:0+events_unbound20:48:315
4008490991412,2cyclictest11939-21kworker/u16:0+events_unbound20:48:315
400850099139,3cyclictest313829-21cat23:24:277
400850099139,3cyclictest1267-21snmpd23:53:037
400850099139,3cyclictest1267-21snmpd22:40:167
400850099138,4cyclictest4071453-21cat19:39:287
400850099138,4cyclictest216970-21cat22:34:307
4008500991310,2cyclictest4146801-21ntpq20:14:427
4008500991310,2cyclictest389254-21ntpq23:59:407
4008500991310,2cyclictest108013-21ntp_states21:34:407
400850099130,11cyclictest159195-21kthreadcore22:04:347
4008495991312,1cyclictest0-21swapper/623:34:456
4008495991312,1cyclictest0-21swapper/619:34:396
4008495991311,2cyclictest128462-21kworker/u16:4+flush-8:021:54:136
4008485991312,1cyclictest0-21swapper/422:04:384
4008485991312,1cyclictest0-21swapper/420:04:304
400848599130,1cyclictest0-21swapper/423:16:224
400850099129,2cyclictest0-21swapper/723:44:357
400850099129,2cyclictest0-21swapper/721:54:267
400850099129,2cyclictest0-21swapper/720:49:447
400850099128,3cyclictest453638-21grep00:34:327
400850099128,3cyclictest1267-21snmpd22:02:227
400850099128,3cyclictest1267-21snmpd19:35:097
400850099128,3cyclictest1267-21snmpd19:30:577
400850099127,4cyclictest296483-21cat23:14:327
400850099127,4cyclictest119791-21cat21:44:287
400850099126,5cyclictest5777-21gmain22:19:347
400850099123,8cyclictest325641-21kthreadcore23:29:327
4008500991210,1cyclictest0-21swapper/722:49:147
400850099120,4cyclictest380476-21munin-run23:59:137
400850099120,11cyclictest49983-21ntpq21:04:397
400850099120,11cyclictest311748-21ntpq23:19:407
400849599129,2cyclictest176791-21chrt22:11:596
4008495991211,1cyclictest0-21swapper/623:50:316
4008495991211,1cyclictest0-21swapper/621:30:036
4008495991211,1cyclictest0-21swapper/621:30:036
4008495991211,1cyclictest0-21swapper/621:21:326
400849599120,1cyclictest0-21swapper/623:06:036
400849599120,1cyclictest0-21swapper/623:06:036
4008490991211,1cyclictest0-21swapper/519:59:585
4008485991211,1cyclictest0-21swapper/423:22:314
4008485991211,1cyclictest0-21swapper/422:49:434
4008485991211,1cyclictest0-21swapper/420:58:254
4008485991211,1cyclictest0-21swapper/420:15:324
4008485991211,1cyclictest0-21swapper/419:46:414
400848599120,1cyclictest0-21swapper/423:26:374
400848599120,1cyclictest0-21swapper/421:18:264
400848599120,1cyclictest0-21swapper/421:00:094
400848599120,1cyclictest0-21swapper/420:13:384
400848599120,11cyclictest0-21swapper/400:04:274
400850099117,3cyclictest4110112-21cat19:59:307
400850099115,4cyclictest177927-21tune2fs22:14:287
400850099110,4cyclictest91055-21irqcore21:29:317
400850099110,4cyclictest91055-21irqcore21:29:317
400850099110,2cyclictest418410-21ntpq00:14:397
400850099110,10cyclictest59707-21ntp_states21:09:417
400850099110,10cyclictest117857-21smart_sda21:39:427
4008495991110,1cyclictest991rcuop/721:04:356
4008495991110,1cyclictest0-21swapper/619:46:006
4008495991110,1cyclictest0-21swapper/600:16:036
4008495991110,1cyclictest0-21swapper/600:11:296
400849599110,1cyclictest0-21swapper/600:33:526
400849599110,11cyclictest0-21swapper/622:53:556
400849599110,11cyclictest0-21swapper/620:23:126
400849599110,11cyclictest0-21swapper/619:54:496
400849599110,11cyclictest0-21swapper/619:54:496
400849599110,11cyclictest0-21swapper/619:22:026
400849599110,0cyclictest0-21swapper/623:45:476
400849599110,0cyclictest0-21swapper/623:10:096
4008490991110,1cyclictest0-21swapper/519:50:595
4008485991110,1cyclictest0-21swapper/423:55:094
4008485991110,1cyclictest0-21swapper/423:50:254
4008485991110,1cyclictest0-21swapper/423:45:414
4008485991110,1cyclictest0-21swapper/423:32:454
4008485991110,1cyclictest0-21swapper/422:57:554
4008485991110,1cyclictest0-21swapper/422:42:004
4008485991110,1cyclictest0-21swapper/421:26:574
4008485991110,1cyclictest0-21swapper/419:13:164
4008485991110,1cyclictest0-21swapper/419:13:164
400848599110,11cyclictest0-21swapper/423:40:574
400848599110,11cyclictest0-21swapper/421:49:584
400848599110,11cyclictest0-21swapper/421:33:534
400848599110,11cyclictest0-21swapper/421:33:534
400848599110,11cyclictest0-21swapper/420:53:134
400848599110,11cyclictest0-21swapper/420:42:484
400848599110,11cyclictest0-21swapper/420:01:304
400848599110,11cyclictest0-21swapper/400:29:124
400848599110,11cyclictest0-21swapper/400:22:354
400848599110,11cyclictest0-21swapper/400:18:104
400848599110,0cyclictest0-21swapper/422:45:474
400848599110,0cyclictest0-21swapper/419:35:204
400849599109,1cyclictest0-21swapper/623:14:156
400849599109,1cyclictest0-21swapper/622:40:036
400849599109,1cyclictest0-21swapper/621:44:146
400849599109,1cyclictest0-21swapper/621:42:306
400849599109,1cyclictest0-21swapper/620:59:476
400849599109,1cyclictest0-21swapper/620:27:186
400849599109,1cyclictest0-21swapper/619:09:166
400849599109,1cyclictest0-21swapper/619:09:166
400849599108,2cyclictest156618-21kworker/u16:5+flush-8:021:59:476
400849099108,2cyclictest390298-21kworker/u16:1+events_unbound00:34:105
400848599109,1cyclictest0-21swapper/422:36:194
40084959998,1cyclictest0-21swapper/623:43:256
40084959998,1cyclictest0-21swapper/623:04:006
40084959998,1cyclictest0-21swapper/622:45:436
40084959998,1cyclictest0-21swapper/622:34:226
40084959998,1cyclictest0-21swapper/621:16:106
40084959998,1cyclictest0-21swapper/620:13:076
40084959998,1cyclictest0-21swapper/619:43:096
40084959998,1cyclictest0-21swapper/600:20:286
40084909998,1cyclictest0-21swapper/523:47:285
40084909997,2cyclictest80003-21kworker/u16:1+flush-8:021:44:435
40084909997,2cyclictest41666-21kworker/u16:0+flush-8:022:18:235
40084909997,2cyclictest4041396-21kworker/u16:4+events_unbound20:09:385
40084859998,1cyclictest0-21swapper/421:37:214
40084859998,1cyclictest0-21swapper/420:48:014
40084859998,1cyclictest0-21swapper/420:48:014
40084859998,1cyclictest0-21swapper/419:58:304
40084859998,1cyclictest0-21swapper/419:58:304
40084859998,1cyclictest0-21swapper/419:49:314
40084859998,1cyclictest0-21swapper/419:43:514
40084859998,1cyclictest0-21swapper/400:35:404
40084859991,7cyclictest0-21swapper/421:40:094
40084959987,1cyclictest0-21swapper/620:40:046
40084959987,1cyclictest0-21swapper/620:29:216
40084959987,1cyclictest0-21swapper/620:17:036
40084959987,1cyclictest0-21swapper/619:28:306
40084959987,1cyclictest0-21swapper/600:24:536
40084909987,1cyclictest0-21swapper/521:01:365
40084859987,1cyclictest0-21swapper/423:59:434
40084859987,1cyclictest0-21swapper/423:05:574
40084859987,1cyclictest0-21swapper/423:05:574
40084859987,1cyclictest0-21swapper/420:34:084
40084859987,1cyclictest0-21swapper/420:21:314
40084859987,1cyclictest0-21swapper/419:32:304
40084859987,1cyclictest0-21swapper/419:19:254
40084959976,1cyclictest0-21swapper/623:30:396
40084959976,1cyclictest0-21swapper/622:55:496
40084959976,1cyclictest0-21swapper/621:35:156
40084959976,1cyclictest0-21swapper/619:51:506
40084959975,2cyclictest69953-21kworker/u16:2+flush-8:021:24:316
40084909976,1cyclictest0-21swapper/523:11:125
40084909975,2cyclictest107983-21kworker/u16:3+events_unbound21:39:375
40084859976,1cyclictest0-21swapper/422:59:484
40084859976,1cyclictest0-21swapper/422:19:274
40084859976,1cyclictest0-21swapper/421:21:454
40084859976,1cyclictest0-21swapper/420:38:244
40084859974,2cyclictest5747-21gnome-shell21:54:234
40084959965,1cyclictest0-21swapper/622:30:356
40084959965,1cyclictest0-21swapper/622:24:556
40084959965,1cyclictest0-21swapper/622:04:256
40084959965,1cyclictest0-21swapper/620:03:496
40084959964,1cyclictest681rcuog/423:59:296
40084959963,2cyclictest41283042sleep620:09:096
40084959960,5cyclictest5873-21gsd-housekeepin00:38:546
40084859965,1cyclictest0-21swapper/423:34:394
40084859965,1cyclictest0-21swapper/422:30:394
40084859965,1cyclictest0-21swapper/420:25:374
40084859963,2cyclictest4018467-21timerandwakeup19:14:144
40084859963,2cyclictest0-21swapper/422:04:134
40084859962,4cyclictest0-21swapper/400:13:554
40084859962,2cyclictest0-21swapper/421:44:484
40084859962,2cyclictest0-21swapper/419:24:494
40084859960,5cyclictest5873-21gsd-housekeepin00:29:544
40084859960,5cyclictest5868-21gsd-color22:28:274
40084859960,5cyclictest5868-21gsd-color21:04:284
40084859960,1cyclictest0-21swapper/421:12:164
40084959951,1cyclictest681rcuog/421:09:286
40084959950,5cyclictest0-21swapper/620:44:206
40084959950,5cyclictest0-21swapper/620:44:206
40084959950,3cyclictest0-21swapper/620:34:366
40084859950,4cyclictest283983-21chrt23:09:264
40084859950,4cyclictest177342-21taskset22:14:134
40084859950,4cyclictest176645-21chrt22:09:574
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional