You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-18 - 03:53
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Thu Dec 18, 2025 00:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
120633725343,7sleep60-21swapper/619:06:596
120651525217,30sleep70-21swapper/719:09:327
120636224029,8sleep40-21swapper/419:07:214
120650423928,8sleep50-21swapper/519:09:225
1206824993533,2cyclictest1258780-21kworker/u16:1+flush-8:019:40:074
1206835993428,5cyclictest1666793-21latency_hist23:04:377
1206835993428,5cyclictest1666793-21latency_hist23:04:377
1206832993129,2cyclictest1793163-21kworker/u16:2+flush-8:000:14:376
1206832993129,2cyclictest1216318-21kworker/u16:2+events_unbound19:29:536
1206824993129,2cyclictest1288582-21kworker/u16:4+flush-8:020:09:374
1206824993028,2cyclictest1734462-21kworker/u16:4+flush-8:000:04:374
1206832992927,2cyclictest1530586-21kworker/u16:3+events_unbound22:00:386
1206832992927,2cyclictest1490858-21kworker/u16:4+flush-8:021:49:376
1206832992927,2cyclictest1288582-21kworker/u16:4+events_unbound20:07:366
1206832992926,2cyclictest1793163-21kworker/u16:2+events_unbound00:14:386
1206828992927,2cyclictest1657083-21kworker/u16:1+flush-8:022:59:515
1206828992927,2cyclictest1657083-21kworker/u16:1+flush-8:022:59:515
1206824992927,2cyclictest1490858-21kworker/u16:4+flush-8:021:54:374
1206824992927,2cyclictest1288352-21kworker/u16:3+events_unbound19:59:344
13956972280,1chrt1395698-21cat20:44:496
1206835992827,0cyclictest0-21swapper/722:05:157
1206835992822,5cyclictest1462871-21latency_hist21:19:377
1206828992826,2cyclictest1773283-21kworker/u16:2+events_unbound23:58:505
1206824992826,2cyclictest1599130-21kworker/u16:0+flush-8:022:55:484
1206824992825,2cyclictest1278434-21kworker/u16:0+flush-8:021:19:394
1206835992721,5cyclictest1346406-21latency_hist20:19:387
1206832992725,2cyclictest1336374-21kworker/u16:2+flush-8:020:13:366
1206832992724,2cyclictest1278434-21kworker/u16:0+events_unbound20:24:586
1206828992725,2cyclictest1490858-21kworker/u16:4+flush-8:021:49:515
1206828992725,2cyclictest1278434-21kworker/u16:0+events_unbound20:09:395
1206828992624,2cyclictest1803224-21kworker/u16:1+events_unbound00:22:195
1206828992624,2cyclictest1599130-21kworker/u16:0+events_unbound23:49:375
1206824992623,2cyclictest1345497-21kworker/u16:3+flush-8:020:59:384
17439942250,0chrt1743997-21sed23:40:057
1206835992525,0cyclictest0-21swapper/721:31:487
1206835992522,2cyclictest1618222-21turbostat22:39:377
1206832992523,2cyclictest1745737-21kworker/u16:1+events_unbound00:07:476
1206828992523,2cyclictest1821409-21kworker/u16:0+events_unbound00:30:395
1206828992523,2cyclictest1634624-21kworker/u16:5+events_unbound22:56:105
1206824992523,2cyclictest1258780-21kworker/u16:1+flush-8:019:46:484
1206824992522,2cyclictest1793163-21kworker/u16:2+events_unbound00:14:474
1206835992423,0cyclictest0-21swapper/723:36:557
1206835992423,0cyclictest0-21swapper/722:09:387
1206835992423,0cyclictest0-21swapper/720:30:077
1206835992418,5cyclictest1851357-21latency_hist00:39:377
1206832992422,2cyclictest1549916-21kworker/u16:5+events_unbound22:24:076
1206832992422,2cyclictest1187301-21kworker/u16:1+flush-8:019:13:356
1206832992421,2cyclictest1599131-21kworker/u16:1+flush-8:022:34:386
1206828992422,2cyclictest1675563-21kworker/u16:2+events_unbound23:40:395
1206828992422,2cyclictest1530506-21kworker/u16:2+flush-8:022:39:515
1206828992422,2cyclictest1345497-21kworker/u16:3+flush-8:021:00:105
1206828992422,2cyclictest1345497-21kworker/u16:3+events_unbound20:28:505
1206828992422,2cyclictest1288582-21kworker/u16:4+events_unbound20:17:565
1206828992422,2cyclictest1278434-21kworker/u16:0+events_unbound21:44:055
1206828992422,2cyclictest1278434-21kworker/u16:0+events_unbound19:56:365
1206828992422,2cyclictest1197292-21kworker/u16:0+events_unbound19:26:035
1206824992422,2cyclictest1686589-21kworker/u16:1+flush-8:023:24:584
1206824992421,2cyclictest1803224-21kworker/u16:1+events_unbound00:19:404
1206824992421,2cyclictest1745737-21kworker/u16:1+events_unbound23:54:384
1206835992317,5cyclictest1647370-21latency_hist22:54:377
1206832992321,2cyclictest1745737-21kworker/u16:1+flush-8:023:55:116
1206832992321,2cyclictest1745737-21kworker/u16:1+events_unbound23:51:036
1206832992321,2cyclictest1385623-21kworker/u16:1+events_unbound20:42:046
1206832992321,2cyclictest1336374-21kworker/u16:2+events_unbound20:24:366
1206832992321,2cyclictest1278434-21kworker/u16:0+flush-8:019:51:356
1206832992321,2cyclictest1278434-21kworker/u16:0+events_unbound19:54:546
1206832992321,2cyclictest1187301-21kworker/u16:1+events_unbound19:16:486
1206828992321,2cyclictest1773283-21kworker/u16:2+events_unbound00:02:505
1206828992321,2cyclictest1734462-21kworker/u16:4+events_unbound00:15:285
1206824992321,2cyclictest1414088-21kworker/u16:2+events_unbound21:41:484
1206824992321,2cyclictest1278434-21kworker/u16:0+events_unbound20:40:364
1206835992221,0cyclictest0-21swapper/723:28:077
1206835992221,0cyclictest0-21swapper/721:27:287
1206832992220,2cyclictest1734462-21kworker/u16:4+flush-8:000:24:386
1206832992220,2cyclictest1452838-21kworker/u16:3+events_unbound21:37:486
1206832992220,2cyclictest1414088-21kworker/u16:2+events_unbound21:31:276
1206832992220,2cyclictest1278434-21kworker/u16:0+events_unbound21:05:476
1206828992220,2cyclictest1734462-21kworker/u16:4+flush-8:000:37:265
1206828992220,2cyclictest1734462-21kworker/u16:4+events_unbound23:48:505
1206828992220,2cyclictest1530506-21kworker/u16:2+flush-8:022:28:405
1206828992220,2cyclictest1530506-21kworker/u16:2+events_unbound21:59:025
1206828992220,2cyclictest1414088-21kworker/u16:2+events_unbound21:45:195
1206828992220,2cyclictest1414088-21kworker/u16:2+events_unbound20:52:595
1206828992220,2cyclictest1278434-21kworker/u16:0+events_unbound20:32:515
1206824992220,2cyclictest1530586-21kworker/u16:3+flush-8:021:59:554
1206824992220,2cyclictest1452838-21kworker/u16:3+flush-8:021:17:364
1206824992219,2cyclictest1288352-21kworker/u16:3+flush-8:019:59:384
1206824992219,2cyclictest1278434-21kworker/u16:0+events_unbound21:29:494
1206832992119,2cyclictest1793163-21kworker/u16:2+flush-8:000:22:366
1206832992119,2cyclictest1599130-21kworker/u16:0+flush-8:023:09:156
1206832992119,2cyclictest1278434-21kworker/u16:0+events_unbound20:33:366
1206832992119,2cyclictest1216318-21kworker/u16:2+flush-8:019:20:526
1206828992119,2cyclictest1803224-21kworker/u16:1+events_unbound00:26:435
1206828992119,2cyclictest1793163-21kworker/u16:2+flush-8:000:14:095
1206828992119,2cyclictest1714201-21kworker/u16:3+events_unbound23:30:515
1206828992119,2cyclictest1686589-21kworker/u16:1+events_unbound23:24:515
1206828992119,2cyclictest1675563-21kworker/u16:2+events_unbound23:36:495
1206828992119,2cyclictest1599130-21kworker/u16:0+events_unbound22:48:365
1206828992119,2cyclictest1530586-21kworker/u16:3+flush-8:023:14:125
1206828992119,2cyclictest1530506-21kworker/u16:2+flush-8:022:16:395
1206828992119,2cyclictest1490858-21kworker/u16:4+events_unbound22:02:115
1206828992119,2cyclictest1452838-21kworker/u16:3+events_unbound21:13:125
1206828992119,2cyclictest1345497-21kworker/u16:3+events_unbound20:57:115
1206828992119,2cyclictest1345497-21kworker/u16:3+events_unbound20:39:475
1206828992119,2cyclictest1278434-21kworker/u16:0+events_unbound21:29:515
1206828992119,2cyclictest1278434-21kworker/u16:0+events_unbound20:35:515
1206828992119,2cyclictest1278434-21kworker/u16:0+events_unbound20:35:515
1206828992119,2cyclictest1278434-21kworker/u16:0+events_unbound19:53:405
1206828992119,2cyclictest1258780-21kworker/u16:1+events_unbound19:49:245
1206828992119,2cyclictest1230078-21kworker/u16:3+events_unbound19:39:205
1206828992119,2cyclictest1216318-21kworker/u16:2+events_unbound19:23:035
1206824992119,2cyclictest1675563-21kworker/u16:2+flush-8:023:39:364
1206824992119,2cyclictest1278434-21kworker/u16:0+events_unbound20:25:474
1206824992118,2cyclictest1345497-21kworker/u16:3+flush-8:020:49:574
1206835992019,0cyclictest0-21swapper/723:55:077
1206835992019,0cyclictest0-21swapper/721:48:077
1206835992019,0cyclictest0-21swapper/721:19:537
1206835992019,0cyclictest0-21swapper/720:44:587
1206832992018,2cyclictest1821409-21kworker/u16:0+flush-8:000:30:356
1206832992018,2cyclictest1734462-21kworker/u16:4+events_unbound00:37:516
1206832992018,2cyclictest1714201-21kworker/u16:3+events_unbound23:28:486
1206832992018,2cyclictest1530506-21kworker/u16:2+flush-8:022:13:556
1206828992018,2cyclictest1634624-21kworker/u16:5+flush-8:023:09:065
1206828992018,2cyclictest1599130-21kworker/u16:0+events_unbound00:08:075
1206828992018,2cyclictest1530586-21kworker/u16:3+events_unbound22:04:405
1206828992018,2cyclictest1482197-21kworker/u16:1+events_unbound21:28:195
1206828992018,2cyclictest1336374-21kworker/u16:2+events_unbound20:22:005
1206828992017,2cyclictest1288352-21kworker/u16:3+flush-8:019:59:475
1206824992018,2cyclictest1599130-21kworker/u16:0+events_unbound22:45:484
1206824992017,2cyclictest1734462-21kworker/u16:4+flush-8:000:04:514
1206835991918,0cyclictest0-21swapper/700:13:157
1206832991917,2cyclictest1278434-21kworker/u16:0+flush-8:021:51:236
1206832991917,2cyclictest1278434-21kworker/u16:0+events_unbound21:26:226
1206828991917,2cyclictest1686589-21kworker/u16:1+flush-8:023:23:485
1206828991917,2cyclictest1530506-21kworker/u16:2+events_unbound22:30:475
1206828991917,2cyclictest1452838-21kworker/u16:3+events_unbound21:39:315
1206828991917,2cyclictest1345497-21kworker/u16:3+events_unbound20:48:395
1206828991917,2cyclictest1278434-21kworker/u16:0+events_unbound21:23:435
1206828991917,2cyclictest1278434-21kworker/u16:0+events_unbound21:19:225
1206828991917,2cyclictest1258780-21kworker/u16:1+events_unbound19:40:155
1206824991917,2cyclictest1278434-21kworker/u16:0+flush-8:019:49:564
1206824991916,2cyclictest1429988-21kworker/u16:1+events_unbound21:09:494
1206835991817,0cyclictest0-21swapper/720:35:357
1206835991817,0cyclictest0-21swapper/720:35:357
1206835991816,1cyclictest0-21swapper/722:15:007
1206835991814,3cyclictest1267-21snmpd22:31:057
120683599180,16cyclictest1783364-21latency_hist00:04:377
1206832991816,2cyclictest1745737-21kworker/u16:1+flush-8:023:59:596
1206832991816,2cyclictest1734462-21kworker/u16:4+events_unbound23:46:476
1206832991816,2cyclictest1549916-21kworker/u16:5+flush-8:022:08:076
1206832991816,2cyclictest1278434-21kworker/u16:0+flush-8:021:23:046
1206832991816,2cyclictest1197292-21kworker/u16:0+flush-8:019:28:336
1206828991816,2cyclictest1530586-21kworker/u16:3+events_unbound22:11:035
1206828991816,2cyclictest1258780-21kworker/u16:1+events_unbound19:32:005
1206824991816,2cyclictest1803224-21kworker/u16:1+flush-8:000:29:314
1206824991816,2cyclictest1734462-21kworker/u16:4+flush-8:023:45:024
1206824991816,2cyclictest1599130-21kworker/u16:0+flush-8:023:40:024
1206824991816,2cyclictest1599130-21kworker/u16:0+events_unbound23:14:384
1206832991715,2cyclictest1734462-21kworker/u16:4+flush-8:023:40:076
1206832991715,2cyclictest1599130-21kworker/u16:0+events_unbound23:34:266
1206832991715,2cyclictest1530586-21kworker/u16:3+events_unbound22:17:496
1206832991715,2cyclictest1530506-21kworker/u16:2+flush-8:021:57:116
1206832991715,2cyclictest1452838-21kworker/u16:3+events_unbound21:11:526
1206832991715,2cyclictest1288582-21kworker/u16:4+events_unbound20:19:166
1206832991715,2cyclictest1288352-21kworker/u16:3+events_unbound20:01:446
1206828991715,2cyclictest1530506-21kworker/u16:2+events_unbound22:21:035
1206828991715,2cyclictest1216318-21kworker/u16:2+flush-8:019:18:185
1206828991715,2cyclictest1187301-21kworker/u16:1+flush-8:019:14:135
1206824991715,2cyclictest1599130-21kworker/u16:0+flush-8:022:39:324
1206824991715,2cyclictest1530586-21kworker/u16:3+flush-8:023:11:484
1206824991715,2cyclictest1216318-21kworker/u16:2+flush-8:019:14:334
120683599168,6cyclictest901-21avahi-daemon23:04:557
120683599167,7cyclictest6344-21gmain21:35:027
1206835991615,0cyclictest0-21swapper/719:25:127
1206835991612,3cyclictest1267-21snmpd21:00:207
1206835991610,5cyclictest1306677-21ntpq19:55:017
1206832991614,2cyclictest1634624-21kworker/u16:5+events_unbound22:46:476
1206828991614,2cyclictest1599131-21kworker/u16:1+flush-8:022:36:275
1206828991614,2cyclictest1599130-21kworker/u16:0+flush-8:022:51:275
1206828991614,2cyclictest1258780-21kworker/u16:1+events_unbound20:08:275
1206824991614,2cyclictest1734462-21kworker/u16:4+flush-8:000:09:574
1206824991614,2cyclictest1230078-21kworker/u16:3+flush-8:019:25:494
120683599159,5cyclictest1453144-21latency_hist21:14:377
120683599159,5cyclictest1443458-21latency_hist21:09:377
120683599158,6cyclictest6344-21gmain19:09:547
1206835991514,0cyclictest0-21swapper/722:41:367
120683599150,13cyclictest0-21swapper/720:20:017
1206832991513,2cyclictest1414088-21kworker/u16:2+events_unbound21:03:516
1206828991513,2cyclictest1278434-21kworker/u16:0+flush-8:021:09:145
1206824991513,2cyclictest1793163-21kworker/u16:2+events_unbound00:35:484
1206824991513,2cyclictest1686589-21kworker/u16:1+flush-8:023:19:524
120683599148,5cyclictest1550256-21latency_hist22:04:377
1206835991414,0cyclictest0-21swapper/719:52:477
1206835991413,0cyclictest0-21swapper/720:40:427
1206835991413,0cyclictest0-21swapper/720:25:287
1206835991412,1cyclictest0-21swapper/719:20:057
120683599140,13cyclictest1278226-21taskset19:41:007
1206832991413,1cyclictest0-21swapper/622:59:526
1206832991413,1cyclictest0-21swapper/622:59:526
1206832991412,2cyclictest1345497-21kworker/u16:3+flush-8:020:49:536
1206832991411,2cyclictest1530506-21kworker/u16:2+events_unbound22:39:476
1206824991413,1cyclictest0-21swapper/420:24:344
1206824991412,2cyclictest1599131-21kworker/u16:1+flush-8:022:34:074
1206824991412,2cyclictest1530586-21kworker/u16:3+events_unbound22:19:514
1206824991412,2cyclictest1530506-21kworker/u16:2+events_unbound22:16:474
1206824991412,2cyclictest1414088-21kworker/u16:2+events_unbound21:08:484
1206824991412,2cyclictest1345497-21kworker/u16:3+events_unbound20:58:484
1206824991411,2cyclictest1762949-21ntp_offset23:50:004
120683599139,3cyclictest1267-21snmpd23:15:577
120683599139,3cyclictest1267-21snmpd20:58:207
1206835991312,0cyclictest0-21swapper/722:55:277
1206835991312,0cyclictest0-21swapper/721:50:477
1206835991312,0cyclictest0-21swapper/720:08:497
1206835991311,1cyclictest0-21swapper/719:14:567
1206835991310,2cyclictest1764015-21cat23:54:377
1206835991310,2cyclictest0-21swapper/719:44:387
1206832991312,1cyclictest0-21swapper/622:30:056
1206832991311,2cyclictest1258780-21kworker/u16:1+events_unbound19:42:516
1206832991311,2cyclictest1230078-21kworker/u16:3+flush-8:019:39:286
1206828991310,2cyclictest1599130-21kworker/u16:0+flush-8:023:14:445
1206824991312,1cyclictest0-21swapper/420:37:204
1206824991312,1cyclictest0-21swapper/420:37:204
1206824991311,2cyclictest1258780-21kworker/u16:1+events_unbound19:37:484
1206824991311,2cyclictest1187301-21kworker/u16:1+events_unbound19:17:364
1206824991310,2cyclictest1599130-21kworker/u16:0+events_unbound22:49:514
1206824991310,2cyclictest1336374-21kworker/u16:2+events_unbound20:14:504
120682499130,13cyclictest0-21swapper/422:08:094
120682499130,13cyclictest0-21swapper/421:28:444
120682499130,13cyclictest0-21swapper/420:33:054
120683599127,4cyclictest1636955-21switchtime22:45:067
120683599126,5cyclictest6184-21gvfs-afc-volume21:40:027
120683599126,5cyclictest6184-21gvfs-afc-volume19:30:047
120683599125,6cyclictest1206821-21cyclictest23:09:587
1206835991212,0cyclictest0-21swapper/720:10:197
1206835991212,0cyclictest0-21swapper/719:38:497
120683599120,10cyclictest1534762-21kthreadcore21:54:547
1206832991210,2cyclictest1599130-21kworker/u16:0+flush-8:023:10:286
1206832991210,2cyclictest1345497-21kworker/u16:3+flush-8:020:59:306
1206832991210,2cyclictest1278434-21kworker/u16:0+events_unbound21:15:046
120683299120,1cyclictest0-21swapper/620:36:436
120683299120,1cyclictest0-21swapper/620:36:436
120682499127,1cyclictest1569690-21turbostat22:14:374
1206824991211,1cyclictest0-21swapper/419:20:154
1206824991210,2cyclictest1288582-21kworker/u16:4+events_unbound20:09:574
120683599118,2cyclictest1267-21snmpd23:33:487
120683599118,2cyclictest1267-21snmpd00:31:117
120683599116,4cyclictest1588732-21sshd-session22:20:177
1206835991110,0cyclictest0-21swapper/723:22:057
120683599110,9cyclictest0-21swapper/700:24:557
120683599110,10cyclictest1267-21snmpd20:50:507
120683599110,10cyclictest1267-21snmpd00:05:107
120683299119,2cyclictest1414088-21kworker/u16:2+events_unbound21:41:236
120683299110,11cyclictest0-21swapper/623:23:036
120682499119,2cyclictest1197292-21kworker/u16:0+flush-8:019:29:554
1206824991110,1cyclictest0-21swapper/422:41:254
1206824991110,1cyclictest0-21swapper/422:25:294
120683599106,3cyclictest1267-21snmpd23:47:497
120683599105,4cyclictest1267-21snmpd22:24:507
120683599100,9cyclictest0-21swapper/720:00:067
120683599100,4cyclictest1812392-21runrttasks00:17:447
120683599100,1cyclictest0-21swapper/700:19:517
120683299109,1cyclictest0-21swapper/623:17:136
120683299109,1cyclictest0-21swapper/622:56:056
120683299108,2cyclictest1675563-21kworker/u16:2+events_unbound23:34:556
120683299108,2cyclictest1216318-21kworker/u16:2+flush-8:019:46:596
120683299106,3cyclictest1590221-21cat22:24:526
120682499108,2cyclictest1821409-21kworker/u16:0+flush-8:000:34:324
120682499108,2cyclictest1452838-21kworker/u16:3+flush-8:021:34:554
120682499107,2cyclictest1345497-21kworker/u16:3+flush-8:020:45:084
12068329997,2cyclictest1599130-21kworker/u16:0+flush-8:022:49:526
12068249996,2cyclictest1414088-21kworker/u16:2+flush-8:021:45:044
12068249996,2cyclictest0-21swapper/421:54:554
12068249983,4cyclictest1719439-21cut23:29:564
12068249980,7cyclictest1665862-21ntpq23:00:024
12068249980,7cyclictest1665862-21ntpq23:00:024
12068249970,6cyclictest1667905-21fschecks_time23:04:514
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional