You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-31 - 04:03
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack0slot2.osadl.org (updated Mon Aug 31, 2026 00:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
616389650,61rtkit-daemon0-21swapper/519:09:445
616389650,61rtkit-daemon0-21swapper/519:09:445
8338325644,8sleep40-21swapper/419:06:054
8338325644,8sleep40-21swapper/419:06:054
7432425420,29sleep70-21swapper/719:04:487
7432425420,29sleep70-21swapper/719:04:487
83926995347,4cyclictest686587-21latency_hist23:39:427
83917993634,2cyclictest686979-21kworker/u16:4+events_unbound23:53:404
83917993634,2cyclictest479987-21kworker/u16:2+events_unbound23:13:254
83917993634,2cyclictest479987-21kworker/u16:2+events_unbound23:07:124
83917993634,2cyclictest479987-21kworker/u16:2+events_unbound23:07:124
83917993634,2cyclictest443351-21kworker/u16:3+events_unbound22:06:294
83917993634,2cyclictest345718-21kworker/u16:1+events_unbound22:45:444
83917993634,2cyclictest345718-21kworker/u16:1+events_unbound22:40:494
83917993634,2cyclictest345717-21kworker/u16:0+events_unbound21:56:464
83917993634,2cyclictest253140-21kworker/u16:3+events_unbound21:17:574
83917993633,2cyclictest345718-21kworker/u16:1+events_unbound21:47:414
83917993633,2cyclictest345718-21kworker/u16:1+events_unbound21:47:414
83917993533,2cyclictest735805-21kworker/u16:1+events_unbound00:34:134
83917993533,2cyclictest613865-21kworker/u16:3+events_unbound23:32:054
83917993533,2cyclictest613865-21kworker/u16:3+events_unbound00:04:004
83917993533,2cyclictest565135-21kworker/u16:0+events_unbound23:03:134
83917993533,2cyclictest479987-21kworker/u16:2+events_unbound22:33:334
83917993533,2cyclictest345718-21kworker/u16:1+events_unbound21:41:454
83917993533,2cyclictest345718-21kworker/u16:1+events_unbound21:41:454
83917993533,2cyclictest345717-21kworker/u16:0+events_unbound21:28:144
83917993533,2cyclictest300869-21kworker/u16:5+events_unbound21:51:454
83917993533,2cyclictest194951-21kworker/u16:2+events_unbound21:22:344
8339423525,7sleep60-21swapper/619:06:156
8339423525,7sleep60-21swapper/619:06:156
83917993432,2cyclictest565135-21kworker/u16:0+events_unbound23:59:204
83917993432,2cyclictest479987-21kworker/u16:2+events_unbound22:53:254
83917993432,2cyclictest345718-21kworker/u16:1+events_unbound23:36:054
83917993432,2cyclictest345718-21kworker/u16:1+events_unbound22:17:294
83922993331,2cyclictest300869-21kworker/u16:5+events_unbound21:49:426
83922993331,2cyclictest300869-21kworker/u16:5+events_unbound21:49:426
83917993331,2cyclictest735805-21kworker/u16:1+events_unbound00:27:134
83917993331,2cyclictest735805-21kworker/u16:1+events_unbound00:27:134
83917993331,2cyclictest565135-21kworker/u16:0+events_unbound23:25:204
83917993331,2cyclictest565135-21kworker/u16:0+events_unbound23:22:054
83917993331,2cyclictest479987-21kworker/u16:2+events_unbound23:18:574
83917993331,2cyclictest345718-21kworker/u16:1+events_unbound23:45:454
83917993331,2cyclictest345718-21kworker/u16:1+events_unbound23:45:454
83917993331,2cyclictest345718-21kworker/u16:1+events_unbound22:36:484
83917993331,2cyclictest345718-21kworker/u16:1+events_unbound21:38:054
83917993331,2cyclictest345717-21kworker/u16:0+events_unbound22:24:244
83917993331,2cyclictest300869-21kworker/u16:5+events_unbound21:30:294
83922993230,2cyclictest565135-21kworker/u16:0+events_unbound00:01:086
83917993230,2cyclictest735805-21kworker/u16:1+events_unbound00:15:414
83917993230,2cyclictest443351-21kworker/u16:3+events_unbound22:59:174
83917993230,2cyclictest345718-21kworker/u16:1+events_unbound22:04:414
83917993230,2cyclictest345717-21kworker/u16:0+events_unbound22:14:374
83917993230,2cyclictest194951-21kworker/u16:2+events_unbound21:10:574
83926993129,1cyclictest0-21swapper/722:53:547
83917993129,2cyclictest565135-21kworker/u16:0+events_unbound00:22:124
83917993129,2cyclictest443351-21kworker/u16:3+events_unbound22:25:244
83917993129,2cyclictest345718-21kworker/u16:1+events_unbound23:40:564
83926993024,5cyclictest93508-21latency_hist19:14:437
83922993028,2cyclictest253140-21kworker/u16:3+events_unbound21:13:176
83922993028,2cyclictest253140-21kworker/u16:3+events_unbound20:43:456
83922993028,2cyclictest117130-21kworker/u16:0+events_unbound19:59:006
83917993028,2cyclictest735805-21kworker/u16:1+events_unbound00:38:244
83917993028,2cyclictest735805-21kworker/u16:1+events_unbound00:12:444
83917993028,2cyclictest253140-21kworker/u16:3+events_unbound20:41:144
83917993028,2cyclictest165575-21kworker/u16:3+events_unbound20:22:544
83922992927,2cyclictest443351-21kworker/u16:3+events_unbound22:51:186
83922992927,2cyclictest36355-21kworker/u16:4+events_unbound19:38:016
83922992927,2cyclictest345718-21kworker/u16:1+events_unbound22:24:186
83922992927,2cyclictest345718-21kworker/u16:1+events_unbound22:16:586
83919992927,2cyclictest194951-21kworker/u16:2+flush-8:021:00:455
83917992927,2cyclictest613865-21kworker/u16:3+events_unbound00:09:094
83922992826,2cyclictest686979-21kworker/u16:4+events_unbound23:52:226
83922992826,2cyclictest565135-21kworker/u16:0+events_unbound00:04:496
83922992826,2cyclictest479987-21kworker/u16:2+events_unbound23:12:346
83922992826,2cyclictest345718-21kworker/u16:1+events_unbound23:45:516
83922992826,2cyclictest345718-21kworker/u16:1+events_unbound23:45:516
83922992826,2cyclictest345718-21kworker/u16:1+events_unbound21:51:346
83919992826,1cyclictest0-21swapper/519:34:585
83917992826,2cyclictest253140-21kworker/u16:3+events_unbound20:53:534
8392699270,26cyclictest601469-21latency_hist23:04:427
83922992725,2cyclictest735805-21kworker/u16:1+events_unbound00:32:556
83922992725,2cyclictest565135-21kworker/u16:0+events_unbound22:58:346
83922992725,2cyclictest479987-21kworker/u16:2+events_unbound23:07:106
83922992725,2cyclictest479987-21kworker/u16:2+events_unbound23:07:106
83922992725,2cyclictest443351-21kworker/u16:3+events_unbound22:06:446
83922992725,2cyclictest36355-21kworker/u16:4+events_unbound19:21:526
83922992725,2cyclictest345718-21kworker/u16:1+events_unbound22:01:186
83922992725,2cyclictest300869-21kworker/u16:5+events_unbound21:21:476
83922992725,2cyclictest19826-21kworker/u16:1+events_unbound20:03:026
83922992725,2cyclictest165575-21kworker/u16:3+events_unbound19:53:066
83922992724,2cyclictest345717-21kworker/u16:0+events_unbound21:54:476
6725142270,1chrt672513-21rm23:30:597
6673432270,1chrt0-21swapper/623:30:026
83922992624,2cyclictest735805-21kworker/u16:1+events_unbound00:16:226
83922992624,2cyclictest613865-21kworker/u16:3+events_unbound23:24:356
83922992624,2cyclictest565135-21kworker/u16:0+events_unbound23:56:466
83922992624,2cyclictest565135-21kworker/u16:0+events_unbound00:22:306
83922992624,2cyclictest443351-21kworker/u16:3+events_unbound22:43:276
83922992624,2cyclictest345718-21kworker/u16:1+events_unbound23:37:276
83922992624,2cyclictest345718-21kworker/u16:1+events_unbound22:48:226
83922992624,2cyclictest300869-21kworker/u16:5+events_unbound21:43:476
83922992624,2cyclictest300869-21kworker/u16:5+events_unbound21:43:476
83922992624,2cyclictest194951-21kworker/u16:2+events_unbound21:18:386
83922992624,2cyclictest117130-21kworker/u16:0+flush-8:020:09:576
83922992624,2cyclictest117130-21kworker/u16:0+events_unbound20:47:066
83917992624,2cyclictest36355-21kworker/u16:4+events_unbound19:15:544
83917992624,2cyclictest300869-21kworker/u16:5+events_unbound21:01:184
83926992520,4cyclictest382322-21latency_hist21:34:427
83922992523,2cyclictest784512-21kworker/u16:5+events_unbound00:26:226
83922992523,2cyclictest784512-21kworker/u16:5+events_unbound00:26:226
83922992523,2cyclictest613865-21kworker/u16:3+events_unbound23:41:316
83922992523,2cyclictest345718-21kworker/u16:1+events_unbound22:59:466
83922992523,2cyclictest300869-21kworker/u16:5+events_unbound21:28:206
83922992523,2cyclictest300869-21kworker/u16:5+events_unbound21:07:026
83922992523,2cyclictest300869-21kworker/u16:5+events_unbound21:03:376
83922992523,2cyclictest281419-21kworker/u16:1+events_unbound20:56:586
83922992523,2cyclictest224041-21kworker/u16:4+events_unbound20:21:446
83922992523,2cyclictest19826-21kworker/u16:1+events_unbound19:11:176
83922992523,2cyclictest117130-21kworker/u16:0+events_unbound19:33:576
83922992523,2cyclictest117130-21kworker/u16:0+events_unbound19:33:576
83919992521,3cyclictest443351-21kworker/u16:3+flush-8:022:35:415
83917992523,2cyclictest36355-21kworker/u16:4+events_unbound19:30:534
83917992523,2cyclictest36355-21kworker/u16:4+events_unbound19:30:534
83917992522,2cyclictest165575-21kworker/u16:3+events_unbound19:49:454
8392699240,1cyclictest0-21swapper/700:15:097
83922992422,2cyclictest735805-21kworker/u16:1+events_unbound00:38:226
83922992422,2cyclictest613865-21kworker/u16:3+events_unbound00:11:316
83922992422,2cyclictest36355-21kworker/u16:4+events_unbound19:18:056
83922992422,2cyclictest345718-21kworker/u16:1+events_unbound22:13:396
83922992422,2cyclictest300869-21kworker/u16:5+events_unbound21:33:116
83922992422,2cyclictest253140-21kworker/u16:3+events_unbound20:50:576
83922992422,2cyclictest165575-21kworker/u16:3+events_unbound20:18:056
83922992422,2cyclictest165575-21kworker/u16:3+events_unbound20:06:336
83922992422,2cyclictest117130-21kworker/u16:0+events_unbound19:41:096
83922992421,2cyclictest345717-21kworker/u16:0+events_unbound21:34:516
83917992422,2cyclictest36355-21kworker/u16:4+events_unbound19:19:494
83917992422,2cyclictest194951-21kworker/u16:2+events_unbound20:37:534
83926992322,0cyclictest0-21swapper/723:45:327
83926992322,0cyclictest0-21swapper/723:45:327
83926992322,0cyclictest0-21swapper/722:10:457
83926992322,0cyclictest0-21swapper/720:32:387
83922992321,2cyclictest565135-21kworker/u16:0+events_unbound23:26:236
83922992321,2cyclictest224041-21kworker/u16:4+events_unbound20:26:336
83922992321,2cyclictest117130-21kworker/u16:0+events_unbound19:48:306
83917992321,2cyclictest117130-21kworker/u16:0+events_unbound20:25:544
83926992221,0cyclictest0-21swapper/720:02:057
83926992221,0cyclictest0-21swapper/719:16:577
83926992221,0cyclictest0-21swapper/700:35:137
83926992220,1cyclictest745271-21ssh00:00:237
83926992217,4cyclictest735371-21latency_hist23:59:427
83926992217,4cyclictest321317-21latency_hist21:09:427
83926992217,4cyclictest155680-21latency_hist19:44:437
83922992220,2cyclictest443351-21kworker/u16:3+events_unbound22:39:116
83922992220,2cyclictest443351-21kworker/u16:3+events_unbound22:28:386
83922992220,2cyclictest253140-21kworker/u16:3+events_unbound20:38:136
83922992220,2cyclictest117130-21kworker/u16:0+events_unbound20:33:336
83917992219,2cyclictest300869-21kworker/u16:5+events_unbound21:04:554
83917992219,2cyclictest194951-21kworker/u16:2+events_unbound20:09:504
83926992120,0cyclictest0-21swapper/722:20:237
83926992120,0cyclictest0-21swapper/720:27:247
83926992120,0cyclictest0-21swapper/720:20:597
83926992120,0cyclictest0-21swapper/720:11:447
83926992120,0cyclictest0-21swapper/719:25:377
83926992119,1cyclictest0-21swapper/720:37:497
83922992119,2cyclictest613865-21kworker/u16:3+events_unbound23:19:036
83922992119,2cyclictest19826-21kworker/u16:1+events_unbound19:26:336
83919992119,2cyclictest345718-21kworker/u16:1+flush-8:021:35:415
83917992119,2cyclictest117130-21kworker/u16:0+events_unbound20:17:574
83917992119,2cyclictest117130-21kworker/u16:0+events_unbound20:03:534
83917992018,2cyclictest36355-21kworker/u16:4+events_unbound19:26:024
83926991918,0cyclictest0-21swapper/722:05:317
83926991918,0cyclictest0-21swapper/719:33:297
83926991918,0cyclictest0-21swapper/719:33:297
83926991914,4cyclictest333475-21latency_hist21:14:437
83922991917,2cyclictest443351-21kworker/u16:3+events_unbound22:30:316
83917991917,2cyclictest117130-21kworker/u16:0+events_unbound19:44:014
83926991817,0cyclictest0-21swapper/719:47:287
8392699180,16cyclictest342679-21sh21:15:087
83917991816,2cyclictest19826-21kworker/u16:1+flush-8:019:10:084
83917991816,2cyclictest147150-21kworker/u16:2+events_unbound19:46:024
83926991715,1cyclictest0-21swapper/720:05:547
8391999170,16cyclictest342613-21ntpq21:15:075
83926991615,0cyclictest0-21swapper/722:45:187
83926991615,0cyclictest0-21swapper/719:53:357
83926991615,0cyclictest0-21swapper/719:36:277
83926991613,2cyclictest0-21swapper/700:24:427
83926991613,2cyclictest0-21swapper/700:24:427
8392699160,1cyclictest0-21swapper/721:55:067
8392699160,14cyclictest537654-21ssh22:35:167
8391999161,14cyclictest167007-21kthreadcore19:49:595
83917991614,2cyclictest36355-21kworker/u16:4+events_unbound19:36:064
83917991614,2cyclictest194951-21kworker/u16:2+flush-8:020:05:164
83917991614,2cyclictest117130-21kworker/u16:0+events_unbound20:46:254
83917991614,2cyclictest117130-21kworker/u16:0+events_unbound20:33:374
83926991514,0cyclictest0-21swapper/721:25:407
83926991514,0cyclictest0-21swapper/720:49:507
83926991513,1cyclictest418091-21ssh21:48:147
83926991513,1cyclictest418091-21ssh21:48:147
83926991512,2cyclictest0-21swapper/720:54:427
83919991512,2cyclictest271655-21ntpq20:40:075
83926991413,0cyclictest0-21swapper/721:34:437
83926991413,0cyclictest0-21swapper/700:09:267
83926991412,1cyclictest660104-21ssh23:25:337
83926991412,1cyclictest0-21swapper/723:50:007
83926991411,2cyclictest589331-21munin-run22:59:417
83926991411,2cyclictest1277-21snmpd21:53:467
8392699140,13cyclictest650163-21latency_hist23:24:427
83919991411,2cyclictest0-21swapper/523:24:575
8391999140,6cyclictest0-21swapper/520:49:585
83917991412,2cyclictest194951-21kworker/u16:2+events_unbound20:58:344
8392699139,3cyclictest1277-21snmpd22:25:467
8392699139,3cyclictest1277-21snmpd00:34:327
8392699137,5cyclictest223827-21latency_hist20:19:427
83926991311,1cyclictest0-21swapper/721:20:047
8391999130,1cyclictest0-21swapper/500:05:325
8391999130,13cyclictest0-21swapper/523:41:245
8391999130,13cyclictest0-21swapper/500:22:435
8392699129,2cyclictest1277-21snmpd23:14:187
8392699129,2cyclictest1277-21snmpd22:02:527
8392699129,2cyclictest1277-21snmpd20:49:117
8392699129,2cyclictest0-21swapper/719:59:437
8392699126,5cyclictest5994-21gmain00:10:437
8392699126,5cyclictest272601-21latency_hist20:44:437
83926991212,0cyclictest0-21swapper/723:05:197
83926991212,0cyclictest0-21swapper/723:05:197
8391999128,3cyclictest347053-21cat21:20:005
8391999127,4cyclictest407999-21cat21:44:575
8391999127,4cyclictest407999-21cat21:44:575
83919991211,1cyclictest0-21swapper/521:31:495
83919991211,1cyclictest0-21swapper/500:17:305
83919991211,1cyclictest0-21swapper/500:00:195
8391999120,1cyclictest0-21swapper/500:27:555
8391999120,1cyclictest0-21swapper/500:27:555
8391999120,12cyclictest0-21swapper/523:49:275
8391999120,12cyclictest0-21swapper/523:49:275
8391999120,12cyclictest0-21swapper/522:17:325
8391999120,12cyclictest0-21swapper/522:00:125
8392699119,1cyclictest406631-21ssh21:44:337
8392699119,1cyclictest406631-21ssh21:44:337
8392699119,1cyclictest0-21swapper/722:40:047
8392699118,2cyclictest1277-21snmpd22:33:387
8392699118,2cyclictest1277-21snmpd19:21:437
8392699117,3cyclictest1277-21snmpd23:39:547
8392699115,5cyclictest302782-21tune2fs20:59:557
83919991110,1cyclictest0-21swapper/523:56:425
83919991110,1cyclictest0-21swapper/523:03:535
83919991110,1cyclictest0-21swapper/522:45:455
83919991110,1cyclictest0-21swapper/521:26:565
83919991110,1cyclictest0-21swapper/520:21:405
83919991110,1cyclictest0-21swapper/519:46:505
83919991110,1cyclictest0-21swapper/500:37:325
8391999110,1cyclictest0-21swapper/519:09:475
8391999110,11cyclictest0-21swapper/523:53:045
8391999110,11cyclictest0-21swapper/521:13:045
8391999110,11cyclictest0-21swapper/520:59:215
8391999110,11cyclictest0-21swapper/520:48:565
8391999110,11cyclictest0-21swapper/519:27:075
8391999110,11cyclictest0-21swapper/519:18:275
8391999110,11cyclictest0-21swapper/500:32:205
8391999110,0cyclictest0-21swapper/519:23:115
8391799118,2cyclictest165575-21kworker/u16:3+events_unbound19:54:464
8392699107,2cyclictest1277-21snmpd22:16:167
8392699100,4cyclictest626266-21/usr/sbin/munin23:15:137
8391999109,1cyclictest0-21swapper/523:37:475
8391999109,1cyclictest0-21swapper/523:30:325
8391999109,1cyclictest0-21swapper/522:56:385
8391999109,1cyclictest0-21swapper/522:53:485
8391999109,1cyclictest0-21swapper/522:20:225
8391999109,1cyclictest0-21swapper/522:06:405
8391999109,1cyclictest0-21swapper/520:33:395
8391999109,1cyclictest0-21swapper/520:14:535
8391999109,1cyclictest0-21swapper/500:10:445
8391999106,3cyclictest186028-21cat19:59:585
8391999100,6cyclictest0-21swapper/521:55:015
839269997,1cyclictest0-21swapper/700:19:557
839199998,1cyclictest0-21swapper/523:24:045
839199998,1cyclictest0-21swapper/522:42:085
839199998,1cyclictest0-21swapper/522:13:555
839199998,1cyclictest0-21swapper/521:50:065
839199998,1cyclictest0-21swapper/520:36:295
839199998,1cyclictest0-21swapper/519:31:515
839199998,1cyclictest0-21swapper/519:31:515
839199996,2cyclictest0-21swapper/522:24:585
839199993,2cyclictest0-21swapper/521:43:565
839199993,2cyclictest0-21swapper/521:43:565
839199984,3cyclictest606456-21cut23:05:015
839199984,3cyclictest606456-21cut23:05:015
839199984,3cyclictest517629-21cat22:30:005
839199984,3cyclictest242395-21ntpq20:25:055
839199983,4cyclictest627608-21cut23:15:005
839199983,4cyclictest623085-21timerandwakeup23:10:095
839199983,4cyclictest195378-21expr20:04:555
839199983,4cyclictest147151-21iostat19:39:585
839199980,3cyclictest0-21swapper/521:04:585
839199973,3cyclictest205091-21expr20:09:555
839199973,3cyclictest176014-21df19:54:565
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional