You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-15 - 11:33
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Mon Dec 15, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
25503772730,1sleep42550379-21awk23:50:114
199251726756,8sleep60-21swapper/619:05:546
199278125545,7sleep40-21swapper/419:09:374
199251825419,30sleep70-21swapper/719:05:557
199270824333,7sleep50-21swapper/519:08:345
1993086993024,5cyclictest2162224-21latency_hist20:34:497
1993086992822,5cyclictest2298369-21latency_hist21:44:497
1993080992826,2cyclictest2562303-21kworker/u16:3+events_unbound00:10:176
1993080992825,3cyclictest1987262-21kworker/u16:2+flush-8:019:55:156
1993075992724,2cyclictest2562303-21kworker/u16:3+flush-8:000:20:044
1993086992620,5cyclictest2629354-21latency_hist00:34:497
1993080992624,2cyclictest2394749-21kworker/u16:2+flush-8:022:54:486
1993076992624,2cyclictest2436018-21kworker/u16:1+events_unbound23:21:005
1993076992624,2cyclictest2293938-21kworker/u16:0+events_unbound21:54:515
1993076992624,2cyclictest2270819-21kworker/u16:1+flush-8:021:40:075
1993076992624,2cyclictest2142429-21kworker/u16:2+events_unbound21:05:195
1993086992523,1cyclictest0-21swapper/719:45:057
1993080992523,2cyclictest2366992-21kworker/u16:1+events_unbound22:38:126
1993080992523,2cyclictest2366992-21kworker/u16:1+events_unbound22:38:126
1993076992522,2cyclictest2503098-21kworker/u16:0+events_unbound00:09:505
1993080992422,2cyclictest2142429-21kworker/u16:2+events_unbound20:40:376
1993080992422,2cyclictest2122371-21kworker/u16:4+events_unbound20:14:206
1993080992422,2cyclictest2122371-21kworker/u16:4+events_unbound20:14:206
1993080992422,2cyclictest2055060-21kworker/u16:0+events_unbound20:00:516
1993076992422,2cyclictest2503098-21kworker/u16:0+events_unbound00:36:115
1993076992422,2cyclictest2453753-21kworker/u16:2+events_unbound23:49:035
1993076992422,2cyclictest2436018-21kworker/u16:1+events_unbound23:03:195
1993075992421,2cyclictest2503098-21kworker/u16:0+events_unbound23:30:024
1993086992318,4cyclictest2356861-21latency_hist22:14:497
199308699230,22cyclictest2113562-21latency_hist20:09:497
1993080992321,2cyclictest1286633-21kworker/u16:3+events_unbound20:06:596
1993076992321,2cyclictest2317547-21kworker/u16:4+events_unbound21:54:205
1993076992321,2cyclictest2293938-21kworker/u16:0+events_unbound22:23:215
1993076992321,2cyclictest2259698-21kworker/u16:4+events_unbound21:27:205
1993076992321,2cyclictest2171770-21kworker/u16:0+events_unbound21:02:485
1993076992321,2cyclictest2171770-21kworker/u16:0+events_unbound21:02:485
1993076992321,2cyclictest2102854-21kworker/u16:1+flush-8:020:19:205
1993076992321,2cyclictest2064161-21kworker/u16:4+events_unbound19:47:405
1993076992321,2cyclictest1987262-21kworker/u16:2+events_unbound19:42:335
1993086992221,0cyclictest0-21swapper/723:45:087
1993080992220,2cyclictest2503098-21kworker/u16:0+events_unbound00:00:506
1993080992220,2cyclictest2462747-21kworker/u16:4+events_unbound23:14:206
1993080992220,2cyclictest2453753-21kworker/u16:2+events_unbound23:21:206
1993080992220,2cyclictest2191279-21kworker/u16:1+events_unbound20:50:376
1993076992220,2cyclictest2293938-21kworker/u16:0+events_unbound23:19:405
1993076992220,2cyclictest2142429-21kworker/u16:2+events_unbound20:50:575
1993080992119,2cyclictest2220386-21kworker/u16:1+events_unbound21:17:006
1993080992119,2cyclictest2142429-21kworker/u16:2+events_unbound21:43:006
1993080992119,2cyclictest1987262-21kworker/u16:2+events_unbound19:12:006
1993076992119,2cyclictest2522574-21kworker/u16:1+events_unbound23:41:205
1993076992119,2cyclictest2462747-21kworker/u16:4+events_unbound23:07:215
1993076992119,2cyclictest2436018-21kworker/u16:1+events_unbound23:12:205
1993076992119,2cyclictest2293938-21kworker/u16:0+events_unbound22:32:195
1993076992119,2cyclictest2270819-21kworker/u16:1+flush-8:021:30:095
1993076992119,2cyclictest2002330-21kworker/u16:1+events_unbound19:10:365
1993086992014,5cyclictest2434618-21latency_hist22:54:497
1993080992018,2cyclictest2162055-21kworker/u16:3+events_unbound21:37:126
1993080992018,2cyclictest2162055-21kworker/u16:3+events_unbound20:36:216
1993080992018,2cyclictest2122371-21kworker/u16:4+events_unbound20:32:216
1993080992017,2cyclictest1987262-21kworker/u16:2+events_unbound19:34:566
1993076992019,1cyclictest2171770-21kworker/u16:0+events_unbound20:57:045
1993076992018,2cyclictest2591524-21kworker/u16:1+events_unbound00:29:595
1993076992018,2cyclictest2503098-21kworker/u16:0+events_unbound23:31:005
1993076992018,2cyclictest2055060-21kworker/u16:0+events_unbound20:29:135
1993076992018,2cyclictest2055060-21kworker/u16:0+events_unbound20:07:405
1993076992018,2cyclictest2035527-21kworker/u16:0+flush-8:019:30:365
1993076992018,2cyclictest1286633-21kworker/u16:3+events_unbound19:21:215
1993075992018,2cyclictest2562303-21kworker/u16:3+events_unbound00:01:434
1993075992018,2cyclictest2503098-21kworker/u16:0+flush-8:023:45:044
1993075992018,2cyclictest2293938-21kworker/u16:0+events_unbound22:23:064
1993075992018,2cyclictest2142429-21kworker/u16:2+flush-8:021:17:214
1993075992016,3cyclictest2162055-21kworker/u16:3+flush-8:020:55:064
1993086991918,0cyclictest0-21swapper/721:05:047
1993080991917,2cyclictest2562303-21kworker/u16:3+events_unbound00:19:406
1993080991917,2cyclictest2522574-21kworker/u16:1+events_unbound23:56:326
1993080991917,2cyclictest2503098-21kworker/u16:0+events_unbound00:31:046
1993080991917,2cyclictest2293938-21kworker/u16:0+events_unbound22:14:006
1993080991917,2cyclictest2293938-21kworker/u16:0+events_unbound22:03:006
1993080991917,2cyclictest2162055-21kworker/u16:3+events_unbound21:34:206
1993080991917,2cyclictest2122371-21kworker/u16:4+events_unbound20:14:506
1993080991917,2cyclictest2055060-21kworker/u16:0+flush-8:020:20:196
1993076991917,2cyclictest2541788-21kworker/u16:4+events_unbound23:51:595
1993076991917,2cyclictest1286633-21kworker/u16:3+events_unbound19:57:125
1993075991917,2cyclictest2503098-21kworker/u16:0+events_unbound00:26:364
1993075991916,2cyclictest1987262-21kworker/u16:2+flush-8:020:00:054
1993086991818,0cyclictest0-21swapper/721:49:447
1993086991815,2cyclictest2103839-21dump-pmu-power20:04:487
1993080991816,2cyclictest2436018-21kworker/u16:1+events_unbound23:28:006
1993080991816,2cyclictest2436018-21kworker/u16:1+events_unbound23:28:006
1993080991816,2cyclictest2171770-21kworker/u16:0+flush-8:020:55:156
1993080991816,2cyclictest1286633-21kworker/u16:3+events_unbound19:46:006
1993076991816,2cyclictest2462747-21kworker/u16:4+events_unbound23:39:405
1993076991816,2cyclictest2436018-21kworker/u16:1+flush-8:023:27:025
1993076991816,2cyclictest2436018-21kworker/u16:1+flush-8:023:27:025
1993076991816,2cyclictest2220386-21kworker/u16:1+flush-8:021:23:205
1993076991816,2cyclictest2122371-21kworker/u16:4+events_unbound20:43:125
1993076991816,2cyclictest2122371-21kworker/u16:4+events_unbound20:11:245
1993076991816,2cyclictest2122371-21kworker/u16:4+events_unbound20:11:245
1993075991816,2cyclictest2503098-21kworker/u16:0+flush-8:023:44:114
1993075991816,2cyclictest2436018-21kworker/u16:1+flush-8:023:25:234
1993075991816,2cyclictest2436018-21kworker/u16:1+flush-8:023:25:234
1993075991816,2cyclictest2142429-21kworker/u16:2+events_unbound22:19:314
1993075991816,2cyclictest1987262-21kworker/u16:2+events_unbound19:55:354
1993075991816,2cyclictest1286633-21kworker/u16:3+events_unbound19:25:434
1993075991815,2cyclictest2293938-21kworker/u16:0+events_unbound22:24:494
1993086991716,0cyclictest0-21swapper/721:25:157
1993086991715,1cyclictest0-21swapper/722:15:077
1993086991713,3cyclictest1267-21snmpd23:01:037
1993080991715,2cyclictest2503098-21kworker/u16:0+events_unbound23:42:366
1993080991715,2cyclictest2394749-21kworker/u16:2+events_unbound22:41:596
1993080991715,2cyclictest2293938-21kworker/u16:0+flush-8:022:20:206
1993080991715,2cyclictest2293938-21kworker/u16:0+events_unbound23:07:316
1993080991715,2cyclictest2270819-21kworker/u16:1+events_unbound21:45:056
1993080991715,2cyclictest2055060-21kworker/u16:0+events_unbound20:26:596
1993080991715,2cyclictest1987262-21kworker/u16:2+flush-8:019:54:456
1993080991714,2cyclictest2394750-21kworker/u16:3+events_unbound22:44:516
1993076991715,2cyclictest2366992-21kworker/u16:1+events_unbound22:29:485
1993076991715,2cyclictest2142429-21kworker/u16:2+events_unbound21:47:165
1993076991715,2cyclictest1987262-21kworker/u16:2+events_unbound19:19:455
1993076991714,2cyclictest2394749-21kworker/u16:2+events_unbound22:49:585
1993075991715,2cyclictest2462747-21kworker/u16:4+flush-8:023:07:074
1993075991715,2cyclictest2394750-21kworker/u16:3+flush-8:022:40:204
1993075991715,2cyclictest2293938-21kworker/u16:0+events_unbound23:04:164
1993075991715,2cyclictest2171770-21kworker/u16:0+events_unbound20:49:194
1993075991715,2cyclictest2162055-21kworker/u16:3+events_unbound21:33:474
1993075991715,2cyclictest2122371-21kworker/u16:4+events_unbound20:20:044
1993086991615,0cyclictest0-21swapper/720:40:167
1993086991613,2cyclictest1267-21snmpd19:10:277
199308699160,1cyclictest0-21swapper/700:15:117
199308699160,14cyclictest2500900-21grep23:25:127
199308699160,14cyclictest2500900-21grep23:25:127
199308699160,14cyclictest2127261-21taskset20:15:077
1993080991614,2cyclictest2462747-21kworker/u16:4+flush-8:023:17:206
1993080991614,2cyclictest2317576-21kworker/u16:5+events_unbound21:51:596
1993080991614,2cyclictest2259698-21kworker/u16:4+events_unbound21:26:216
1993080991614,2cyclictest2220615-21kworker/u16:4+events_unbound21:06:216
1993080991614,2cyclictest2142429-21kworker/u16:2+events_unbound21:58:036
1993080991614,2cyclictest2035527-21kworker/u16:0+events_unbound19:27:366
1993080991614,2cyclictest1987262-21kworker/u16:2+events_unbound19:14:586
1993076991614,2cyclictest2562303-21kworker/u16:3+events_unbound00:00:585
1993076991614,2cyclictest2503098-21kworker/u16:0+events_unbound00:09:205
1993076991614,2cyclictest2394749-21kworker/u16:2+events_unbound22:40:475
1993076991614,2cyclictest2317547-21kworker/u16:4+events_unbound22:04:595
1993076991614,2cyclictest2293938-21kworker/u16:0+events_unbound22:35:095
1993076991614,2cyclictest2293938-21kworker/u16:0+events_unbound22:35:095
1993076991614,2cyclictest2220615-21kworker/u16:4+events_unbound21:15:195
1993076991614,2cyclictest2055060-21kworker/u16:0+events_unbound20:00:595
1993076991614,2cyclictest1286633-21kworker/u16:3+events_unbound19:39:335
1993075991614,2cyclictest2562303-21kworker/u16:3+flush-8:000:39:194
1993075991614,2cyclictest2453753-21kworker/u16:2+events_unbound23:35:424
1993075991614,2cyclictest2366992-21kworker/u16:1+flush-8:022:35:514
1993075991614,2cyclictest2366992-21kworker/u16:1+flush-8:022:35:514
1993075991614,2cyclictest2162055-21kworker/u16:3+events_unbound21:28:074
1993075991614,2cyclictest2142429-21kworker/u16:2+events_unbound22:11:474
1993075991614,2cyclictest2055060-21kworker/u16:0+events_unbound19:42:234
1993086991514,0cyclictest0-21swapper/700:00:077
1993086991513,1cyclictest0-21swapper/722:00:117
1993086991511,3cyclictest1267-21snmpd22:43:157
199308699150,14cyclictest0-21swapper/721:50:157
199308699150,13cyclictest0-21swapper/720:50:147
1993080991513,2cyclictest2562303-21kworker/u16:3+events_unbound00:08:596
1993080991513,2cyclictest2503098-21kworker/u16:0+events_unbound00:25:516
1993080991513,2cyclictest2366992-21kworker/u16:1+flush-8:022:30:196
1993076991513,2cyclictest2503098-21kworker/u16:0+events_unbound00:28:515
1993076991513,2cyclictest2122371-21kworker/u16:4+events_unbound20:20:085
1993075991513,2cyclictest2591524-21kworker/u16:1+flush-8:000:33:414
1993075991513,2cyclictest2462747-21kworker/u16:4+events_unbound23:15:534
1993075991513,2cyclictest2436018-21kworker/u16:1+flush-8:022:58:434
1993075991513,2cyclictest2394750-21kworker/u16:3+events_unbound22:47:434
1993075991513,2cyclictest2293938-21kworker/u16:0+flush-8:022:05:294
1993075991513,2cyclictest2293938-21kworker/u16:0+events_unbound22:03:474
1993075991513,2cyclictest2270819-21kworker/u16:1+flush-8:021:35:434
1993075991513,2cyclictest2171770-21kworker/u16:0+flush-8:020:39:084
1993075991513,2cyclictest2055060-21kworker/u16:0+flush-8:020:10:174
1993075991513,2cyclictest2055060-21kworker/u16:0+flush-8:020:10:174
1993075991513,2cyclictest1286633-21kworker/u16:3+events_unbound20:06:474
1993075991513,2cyclictest1286633-21kworker/u16:3+events_unbound19:46:224
199308699148,5cyclictest1060-21runrttasks21:30:047
1993086991412,1cyclictest0-21swapper/700:20:137
199308699140,3cyclictest1217-21tuned22:45:067
199308699140,12cyclictest2053854-21kthreadcore19:35:117
1993080991412,2cyclictest2162055-21kworker/u16:3+flush-8:021:00:156
1993080991412,2cyclictest2162055-21kworker/u16:3+flush-8:021:00:156
1993076991412,2cyclictest2171770-21kworker/u16:0+events_unbound20:47:365
1993076991412,2cyclictest2162055-21kworker/u16:3+events_unbound21:38:485
1993076991412,2cyclictest1987262-21kworker/u16:2+events_unbound19:27:245
1993076991412,2cyclictest1286633-21kworker/u16:3+events_unbound19:54:115
1993075991412,2cyclictest2541788-21kworker/u16:4+flush-8:000:11:404
1993075991412,2cyclictest2503098-21kworker/u16:0+events_unbound00:16:424
1993075991412,2cyclictest2503098-21kworker/u16:0+events_unbound00:08:104
1993075991412,2cyclictest2220615-21kworker/u16:4+events_unbound21:07:084
1993075991412,2cyclictest2220386-21kworker/u16:1+events_unbound21:23:214
1993075991412,2cyclictest2171770-21kworker/u16:0+events_unbound21:02:194
1993075991412,2cyclictest2171770-21kworker/u16:0+events_unbound21:02:194
1993075991412,2cyclictest2171770-21kworker/u16:0+events_unbound20:54:184
1993075991412,2cyclictest2015786-21kworker/u16:4+flush-8:019:16:524
1993075991412,2cyclictest1972439-21kworker/u16:0+events_unbound19:14:264
1993075991412,2cyclictest1286633-21kworker/u16:3+flush-8:019:32:034
199308699139,3cyclictest1267-21snmpd22:09:297
199308699139,3cyclictest1267-21snmpd20:48:187
199308699139,3cyclictest1267-21snmpd19:52:437
199308699139,3cyclictest1267-21snmpd19:23:047
199308699139,3cyclictest1267-21snmpd19:15:247
199308699138,4cyclictest2094100-21latency_hist19:59:497
199308699136,6cyclictest0-21swapper/719:40:207
199308699135,7cyclictest6045-21gmain23:40:157
199308099139,3cyclictest2358029-21cat22:15:056
199308099138,4cyclictest2017424-21cat19:20:066
199308099130,13cyclictest0-21swapper/623:33:216
1993076991311,2cyclictest2562303-21kworker/u16:3+events_unbound00:17:475
1993076991311,2cyclictest2436018-21kworker/u16:1+events_unbound22:57:165
1993076991311,2cyclictest2293938-21kworker/u16:0+events_unbound22:14:165
1993076991311,2cyclictest2162055-21kworker/u16:3+events_unbound22:03:255
1993076991310,2cyclictest2162055-21kworker/u16:3+flush-8:020:34:525
1993075991312,1cyclictest0-21swapper/419:54:224
1993075991311,2cyclictest2436018-21kworker/u16:1+flush-8:023:20:204
1993075991311,2cyclictest2317576-21kworker/u16:5+events_unbound21:55:114
1993075991311,2cyclictest2293938-21kworker/u16:0+flush-8:021:50:474
1993075991311,2cyclictest2270819-21kworker/u16:1+events_unbound21:47:044
1993075991311,2cyclictest2220615-21kworker/u16:4+events_unbound21:14:474
1993075991311,2cyclictest2142429-21kworker/u16:2+events_unbound20:41:344
1993075991311,2cyclictest2122371-21kworker/u16:4+events_unbound20:34:304
1993075991311,2cyclictest2122371-21kworker/u16:4+events_unbound20:28:504
1993075991311,2cyclictest2102854-21kworker/u16:1+flush-8:020:15:554
1993075991311,2cyclictest1987262-21kworker/u16:2+events_unbound19:37:144
1993075991310,2cyclictest2541788-21kworker/u16:4+events_unbound23:54:534
199308699129,2cyclictest1267-21snmpd23:24:197
199308699129,2cyclictest1267-21snmpd22:54:517
199308699128,3cyclictest2629748-21/usr/sbin/munin00:35:157
199308699128,3cyclictest1267-21snmpd23:53:537
199308699128,3cyclictest1267-21snmpd23:15:017
199308699128,3cyclictest1267-21snmpd23:07:137
199308699128,3cyclictest1267-21snmpd20:36:327
199308699128,3cyclictest1267-21snmpd20:27:417
199308699128,3cyclictest1267-21snmpd19:34:287
199308699128,3cyclictest1267-21snmpd19:25:017
199308699125,6cyclictest0-21swapper/723:33:197
199308699121,10cyclictest2142753-21munin-run20:24:497
199308699120,4cyclictest2214054-21kthreadcore21:00:077
199308699120,4cyclictest2214054-21kthreadcore21:00:077
199308699120,2cyclictest2288901-21cut21:39:487
1993080991210,2cyclictest2503098-21kworker/u16:0+events_unbound23:54:316
1993080991210,2cyclictest2462747-21kworker/u16:4+events_unbound23:35:346
1993080991210,2cyclictest2162055-21kworker/u16:3+events_unbound20:48:156
199308099120,1cyclictest0-21swapper/622:06:006
199308099120,12cyclictest0-21swapper/600:38:376
1993076991211,1cyclictest0-21swapper/521:10:015
1993076991210,2cyclictest2562303-21kworker/u16:3+events_unbound00:20:075
1993076991210,2cyclictest2541788-21kworker/u16:4+events_unbound23:57:315
1993075991210,2cyclictest2436018-21kworker/u16:1+events_unbound23:10:314
1993075991210,2cyclictest2394749-21kworker/u16:2+flush-8:022:50:044
199308699117,3cyclictest6184-21gvfs-afc-volume22:25:027
199308699117,3cyclictest1267-21snmpd21:15:347
199308699115,5cyclictest6184-21gvfs-afc-volume00:10:057
199308699115,5cyclictest6184-21gvfs-afc-volume00:05:107
199308699112,8cyclictest958-21gmain00:29:447
1993086991111,0cyclictest0-21swapper/721:10:147
1993086991110,0cyclictest0-21swapper/720:56:357
199308699110,10cyclictest1267-21snmpd23:11:317
199308699110,10cyclictest1267-21snmpd22:22:477
199308699110,10cyclictest0-21swapper/721:55:127
199308099119,2cyclictest2293938-21kworker/u16:0+events_unbound22:59:036
199308099119,2cyclictest2035527-21kworker/u16:0+events_unbound19:31:486
199308099119,2cyclictest1286633-21kworker/u16:3+flush-8:019:40:046
1993080991110,1cyclictest0-21swapper/621:20:086
199307699119,2cyclictest2293938-21kworker/u16:0+events_unbound22:16:005
1993076991110,1cyclictest0-21swapper/520:30:465
199307699110,1cyclictest0-21swapper/522:46:115
199307599119,2cyclictest1987262-21kworker/u16:2+events_unbound19:20:044
199307599110,0cyclictest0-21swapper/421:43:374
199308699105,4cyclictest2123108-21runrttasks20:12:227
199308699105,4cyclictest2123108-21runrttasks20:12:227
199308699100,9cyclictest1267-21snmpd22:36:157
199308699100,9cyclictest1267-21snmpd22:36:157
199308699100,9cyclictest1267-21snmpd22:31:367
199308699100,9cyclictest1267-21snmpd21:20:317
199308699100,9cyclictest0-21swapper/723:55:137
199308699100,9cyclictest0-21swapper/723:35:067
199308099108,2cyclictest2162055-21kworker/u16:3+events_unbound21:10:476
199307599108,2cyclictest2293938-21kworker/u16:0+events_unbound22:29:584
19930809998,1cyclictest851ktimers/623:00:106
19930809997,2cyclictest2503098-21kworker/u16:0+events_unbound00:20:176
19930809997,2cyclictest2293938-21kworker/u16:0+flush-8:022:25:006
19930809975,2cyclictest2522574-21kworker/u16:1+flush-8:023:44:586
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional