You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-16 - 01:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack0slot2.osadl.org (updated Sat May 16, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
11956932820,1sleep71195691-21rm00:13:107
512063994644,2cyclictest717472-21kworker/u16:1+events_unbound21:03:265
51160224535,7sleep50-21swapper/519:05:305
512075994236,5cyclictest952304-21latency_hist22:32:557
512063994239,2cyclictest1170577-21kworker/u16:5+flush-8:000:23:245
512063994140,1cyclictest660470-21kworker/u16:3+events_unbound21:50:385
512063994139,2cyclictest458313-21kworker/u16:0+events_unbound21:42:535
512063994038,2cyclictest868233-21kworker/u16:4+events_unbound22:16:315
5109942403,31sleep70-21swapper/719:03:317
512063993937,2cyclictest988724-21kworker/u16:5+flush-8:023:08:375
512063993937,2cyclictest819264-21kworker/u16:1+events_unbound22:11:265
512063993836,2cyclictest986442-21kworker/u16:4+events_unbound23:33:375
512063993836,2cyclictest986442-21kworker/u16:4+events_unbound23:27:025
512063993836,2cyclictest916399-21kworker/u16:0+events_unbound22:34:465
512063993836,2cyclictest855502-21kworker/u16:2+events_unbound22:54:015
512063993836,2cyclictest819264-21kworker/u16:1+events_unbound21:54:135
512063993836,2cyclictest819264-21kworker/u16:1+events_unbound21:54:135
512063993836,2cyclictest679397-21kworker/u16:2+events_unbound21:24:505
512063993836,2cyclictest660470-21kworker/u16:3+events_unbound22:42:255
512063993836,2cyclictest458313-21kworker/u16:0+events_unbound21:14:585
512063993836,2cyclictest458313-21kworker/u16:0+events_unbound21:14:585
512063993735,2cyclictest986442-21kworker/u16:4+events_unbound22:50:575
512063993735,2cyclictest458313-21kworker/u16:0+events_unbound21:44:305
512063993735,2cyclictest1084698-21kworker/u16:2+events_unbound23:51:385
51155423726,8sleep40-21swapper/419:04:494
512063993634,2cyclictest986442-21kworker/u16:4+events_unbound23:20:535
512063993634,2cyclictest855502-21kworker/u16:2+events_unbound22:44:225
512063993634,2cyclictest1022746-21kworker/u16:0+events_unbound23:06:335
512063993533,2cyclictest986442-21kworker/u16:4+events_unbound23:39:175
512063993533,2cyclictest868233-21kworker/u16:4+events_unbound22:19:535
512063993533,2cyclictest868233-21kworker/u16:4+events_unbound22:01:215
512063993533,2cyclictest819264-21kworker/u16:1+events_unbound22:05:295
512063993533,2cyclictest660470-21kworker/u16:3+events_unbound22:31:505
512063993533,2cyclictest660470-21kworker/u16:3+events_unbound21:37:145
512063993533,2cyclictest660470-21kworker/u16:3+events_unbound21:09:105
512063993533,2cyclictest458313-21kworker/u16:0+events_unbound21:31:295
512063993533,2cyclictest1084698-21kworker/u16:2+events_unbound23:45:345
512063993533,2cyclictest1084698-21kworker/u16:2+events_unbound00:21:105
512063993533,2cyclictest1022746-21kworker/u16:0+events_unbound23:14:305
512063993432,2cyclictest986442-21kworker/u16:4+events_unbound00:09:335
512063993432,2cyclictest458313-21kworker/u16:0+events_unbound21:19:535
512063993432,2cyclictest1216146-21kworker/u16:1+events_unbound00:32:255
512063993432,2cyclictest1084698-21kworker/u16:2+flush-8:023:31:425
512063993432,2cyclictest1084698-21kworker/u16:2+events_unbound00:14:305
512075993328,4cyclictest843463-21latency_hist21:47:567
512063993331,2cyclictest1170577-21kworker/u16:5+events_unbound00:07:265
512063993331,2cyclictest1109552-21kworker/u16:3+events_unbound23:54:265
512063993331,2cyclictest1084698-21kworker/u16:2+flush-8:000:01:345
512063993331,2cyclictest1084698-21kworker/u16:2+flush-8:000:01:345
512063993230,2cyclictest493876-21kworker/u16:1+events_unbound19:13:245
512063993230,2cyclictest458313-21kworker/u16:0+events_unbound20:10:055
512063993230,2cyclictest1022746-21kworker/u16:0+events_unbound00:35:465
512063993129,2cyclictest553316-21kworker/u16:2+events_unbound19:39:515
512063993028,2cyclictest916399-21kworker/u16:0+events_unbound22:26:335
512063993028,2cyclictest1022746-21kworker/u16:0+events_unbound23:00:265
512075992923,5cyclictest770854-21latency_hist21:17:567
512075992923,5cyclictest770854-21latency_hist21:17:567
512063992927,2cyclictest679397-21kworker/u16:2+events_unbound20:58:235
512063992927,2cyclictest660470-21kworker/u16:3+flush-8:020:46:505
512063992927,2cyclictest660470-21kworker/u16:3+flush-8:020:39:505
512063992927,2cyclictest660470-21kworker/u16:3+events_unbound20:30:505
512063992927,2cyclictest553316-21kworker/u16:2+flush-8:019:23:505
512063992927,2cyclictest458313-21kworker/u16:0+events_unbound20:16:515
51154722918,7sleep60-21swapper/619:04:436
512063992826,2cyclictest553316-21kworker/u16:2+events_unbound20:21:585
512063992725,2cyclictest534102-21kworker/u16:3+events_unbound19:21:195
512063992624,2cyclictest679397-21kworker/u16:2+events_unbound20:50:545
512063992624,2cyclictest534102-21kworker/u16:3+events_unbound19:32:515
51207599250,24cyclictest124-21kswapd023:23:097
512063992523,2cyclictest717472-21kworker/u16:1+events_unbound20:57:545
512063992523,2cyclictest592403-21kworker/u16:1+events_unbound19:55:575
512061992522,2cyclictest458313-21kworker/u16:0+flush-8:020:03:124
512063992422,2cyclictest592403-21kworker/u16:1+events_unbound20:00:225
512063992422,2cyclictest458313-21kworker/u16:0+flush-8:020:23:505
512061992422,2cyclictest974151-21kworker/u16:1+events_unbound22:48:094
512075992316,6cyclictest831364-21latency_hist21:42:567
512075992221,0cyclictest0-21swapper/700:03:107
512075992217,4cyclictest635-21systemd-journal22:27:567
512063992220,2cyclictest602464-21kworker/u16:4+events_unbound20:37:215
512063992220,2cyclictest602464-21kworker/u16:4+events_unbound20:37:215
512063992220,2cyclictest458313-21kworker/u16:0+events_unbound19:37:365
512061992219,2cyclictest1084698-21kworker/u16:2+flush-8:000:23:214
512075992113,7cyclictest1133878-21latency_hist23:47:567
51207599200,18cyclictest1073334-21latency_hist23:22:567
512075991915,3cyclictest124-21kswapd022:46:117
512063991816,2cyclictest458313-21kworker/u16:0+flush-8:020:03:015
512063991816,2cyclictest458313-21kworker/u16:0+events_unbound19:09:515
51207599170,15cyclictest997701-21ssh22:48:207
51207599167,4cyclictest6382-21gvfs-afc-volume23:58:157
51207599167,4cyclictest6382-21gvfs-afc-volume23:58:157
512075991615,0cyclictest0-21swapper/720:33:107
512075991615,0cyclictest0-21swapper/720:33:107
512075991613,2cyclictest0-21swapper/723:48:197
512075991610,5cyclictest746647-21latency_hist21:07:567
51207599160,14cyclictest0-21swapper/719:48:217
51207599160,14cyclictest0-21swapper/719:48:217
51207199160,16cyclictest0-21swapper/621:05:116
51207199160,16cyclictest0-21swapper/620:34:276
51207199160,16cyclictest0-21swapper/620:34:276
51207199160,16cyclictest0-21swapper/620:23:126
51207199160,16cyclictest0-21swapper/620:08:516
51207199160,16cyclictest0-21swapper/619:48:276
51207199160,16cyclictest0-21swapper/619:48:276
51207199160,16cyclictest0-21swapper/619:41:176
51207199160,16cyclictest0-21swapper/619:31:026
51207199160,16cyclictest0-21swapper/619:26:576
512063991615,1cyclictest458313-21kworker/u16:0+events_unbound19:44:155
512063991614,2cyclictest592403-21kworker/u16:1+flush-8:019:49:305
512063991614,2cyclictest592403-21kworker/u16:1+flush-8:019:49:305
512061991613,2cyclictest660032-21kworker/u16:1+events_unbound20:23:124
512061991611,4cyclictest881090-21iostat_ios22:03:114
51206199160,15cyclictest1117791-21kthreadcore23:38:154
51207599152,5cyclictest1183579-21ssh00:08:097
512075991512,2cyclictest124-21kswapd023:13:087
512075991512,2cyclictest0-21swapper/719:32:577
512075991511,3cyclictest1234-21snmpd20:17:487
51207599150,1cyclictest0-21swapper/722:08:187
51207199155,7cyclictest0-21swapper/621:13:046
51207199155,7cyclictest0-21swapper/621:13:046
512071991514,1cyclictest841rcuc/622:04:346
51207199150,1cyclictest0-21swapper/619:43:086
51207199150,15cyclictest0-21swapper/621:02:066
51207199150,15cyclictest0-21swapper/620:15:006
51206199150,1cyclictest0-21swapper/421:21:534
51206199150,1cyclictest0-21swapper/400:14:504
51207599149,4cyclictest1234-21snmpd20:39:287
51207599146,7cyclictest5975-21gmain21:18:377
512075991411,2cyclictest1243977-21ssh00:33:127
512075991410,3cyclictest1234-21snmpd22:55:507
51207599140,1cyclictest0-21swapper/723:33:177
512071991413,1cyclictest0-21swapper/623:34:456
512071991413,1cyclictest0-21swapper/623:18:216
512071991413,1cyclictest0-21swapper/622:34:316
512071991413,1cyclictest0-21swapper/621:19:576
512071991413,1cyclictest0-21swapper/600:22:406
51207199140,1cyclictest0-21swapper/622:47:556
51207199140,14cyclictest0-21swapper/620:02:476
51207199140,13cyclictest0-21swapper/619:33:056
512061991413,1cyclictest0-21swapper/423:07:594
512061991413,1cyclictest0-21swapper/422:42:274
512061991413,1cyclictest0-21swapper/422:30:564
512061991413,1cyclictest0-21swapper/422:11:424
512061991413,1cyclictest0-21swapper/421:55:374
512061991413,1cyclictest0-21swapper/421:55:374
512061991413,1cyclictest0-21swapper/421:39:044
51206199140,14cyclictest0-21swapper/423:55:074
51206199140,14cyclictest0-21swapper/422:20:134
51206199140,14cyclictest0-21swapper/421:13:414
51206199140,14cyclictest0-21swapper/421:13:414
51207599139,3cyclictest1234-21snmpd21:23:357
51207599139,3cyclictest1234-21snmpd20:54:077
51207599139,3cyclictest1234-21snmpd20:31:197
51207599138,4cyclictest758732-21latency_hist21:12:567
51207599137,5cyclictest717800-21latency_hist20:52:567
51207599130,11cyclictest1234-21snmpd21:28:027
51207599130,11cyclictest1234-21snmpd19:12:027
512071991312,1cyclictest0-21swapper/621:55:536
512071991312,1cyclictest0-21swapper/621:55:536
512071991312,1cyclictest0-21swapper/621:28:376
512071991312,1cyclictest0-21swapper/621:11:356
51207199130,1cyclictest0-21swapper/623:02:446
51207199130,13cyclictest0-21swapper/623:53:596
51206199138,4cyclictest603529-21cat19:53:124
512061991312,1cyclictest0-21swapper/423:23:074
512061991311,2cyclictest458313-21kworker/u16:0+events_unbound19:23:114
51207599129,2cyclictest1234-21snmpd21:59:397
51207599129,2cyclictest1234-21snmpd21:56:307
51207599129,2cyclictest1234-21snmpd21:56:307
51207599129,2cyclictest0-21swapper/720:57:577
51207599128,3cyclictest1234-21snmpd22:58:057
51207599128,3cyclictest1234-21snmpd20:19:217
51207599127,4cyclictest635-21systemd-journal00:22:567
51207599126,5cyclictest6382-21gvfs-afc-volume22:21:187
51207599126,5cyclictest611981-21latency_hist19:57:567
51207599126,5cyclictest6101-21gmain19:18:137
512075991211,0cyclictest0-21swapper/720:07:577
51207599120,10cyclictest124-21kswapd023:38:087
51207599120,10cyclictest1234-21snmpd23:03:117
51207199126,4cyclictest681rcuog/423:23:036
51207199124,5cyclictest0-21swapper/623:15:376
51207199123,8cyclictest851837-21tr21:48:166
51207199123,7cyclictest0-21swapper/600:30:146
51207199122,9cyclictest699379-21cstates20:43:076
51207199122,9cyclictest1190259-21cut00:08:156
51207199122,9cyclictest1032582-21cut23:03:156
51207199122,4cyclictest11347491cstates23:48:076
512071991211,1cyclictest0-21swapper/622:22:046
512071991211,1cyclictest0-21swapper/621:47:516
512071991210,2cyclictest86-21ksoftirqd/620:03:176
51207199120,12cyclictest0-21swapper/619:09:326
512061991211,1cyclictest0-21swapper/422:53:294
512061991211,1cyclictest0-21swapper/420:36:574
512061991211,1cyclictest0-21swapper/420:36:574
512061991211,1cyclictest0-21swapper/420:18:024
51206199120,12cyclictest0-21swapper/420:55:244
51206199120,12cyclictest0-21swapper/419:45:144
51206199120,0cyclictest0-21swapper/421:05:194
51207599117,3cyclictest6895-21gmain23:53:087
51207599117,3cyclictest6895-21gmain22:38:417
51207599117,3cyclictest1234-21snmpd20:44:227
51207599117,3cyclictest1234-21snmpd19:41:127
51207599117,3cyclictest1234-21snmpd19:32:337
51207599117,3cyclictest1234-21snmpd19:17:027
51207599116,5cyclictest6382-21gvfs-afc-volume21:35:237
51207599116,4cyclictest1234-21snmpd23:28:537
51207599114,5cyclictest1232343-21rm00:28:117
512075991111,0cyclictest0-21swapper/721:49:297
51207599110,10cyclictest1234-21snmpd22:14:167
51207599110,10cyclictest1234-21snmpd19:44:397
51207199116,4cyclictest968504-21tr22:38:156
51207199115,5cyclictest1046464-21timerandwakeup23:08:226
51207199115,5cyclictest0-21swapper/622:23:156
51207199112,8cyclictest944803-21kthreadcore22:28:146
51207199112,8cyclictest868404-21tr21:58:066
51207199112,8cyclictest819699-21/usr/sbin/munin21:38:206
51207199112,5cyclictest7912991kthreadcore21:23:166
51207199111,5cyclictest908208-21kthreadcore22:13:156
51207199110,11cyclictest0-21swapper/620:48:486
51206199117,3cyclictest916399-21kworker/u16:0+flush-8:022:33:334
512061991110,1cyclictest0-21swapper/421:29:554
512061991110,1cyclictest0-21swapper/420:45:374
51207599107,2cyclictest0-21swapper/722:33:117
51207599106,3cyclictest798-17auditd20:23:137
51207599106,3cyclictest1234-21snmpd22:04:217
51207599106,3cyclictest1234-21snmpd20:06:157
51207599106,3cyclictest1234-21snmpd19:24:507
51207599105,4cyclictest1215467-21ntpq00:18:217
51207599104,5cyclictest6382-21gvfs-afc-volume23:09:307
51207599100,9cyclictest1053-21ntpd20:02:007
51207199106,4cyclictest0-21swapper/600:17:146
51207199106,3cyclictest807814-21cpuspeed_turbos21:33:086
51207199106,3cyclictest655608-21cut20:18:156
51207199102,7cyclictest724842-21cut20:53:176
51207199102,7cyclictest1220568-21cut00:23:136
51207199102,7cyclictest1164661-21tr23:58:186
51207199102,7cyclictest1164661-21tr23:58:186
51207199102,7cyclictest1118362-21sed23:38:166
51207199101,8cyclictest995252-21tr22:48:156
51207199101,8cyclictest0-21swapper/622:08:236
51207199101,3cyclictest1086225-21cat23:28:086
51207199100,9cyclictest607544-21grep19:53:166
51207199100,9cyclictest0-21swapper/622:53:156
51207199100,4cyclictest1124503-21grep23:43:126
51206199106,3cyclictest1084698-21kworker/u16:2+flush-8:023:28:374
5120719997,2cyclictest86-21ksoftirqd/600:33:106
5120719995,3cyclictest670546-21cstates20:28:096
5120719992,6cyclictest692824-21grep20:38:146
5120719992,6cyclictest529691-21grep19:13:156
5120719990,8cyclictest535410-21/usr/sbin/munin19:18:106
5120619996,2cyclictest0-21swapper/423:03:134
5120619995,3cyclictest868871-21tune2fs21:58:084
5120619994,4cyclictest755617-21ntpq21:08:194
5120619994,4cyclictest638318-21cut20:08:164
5120619990,8cyclictest1243909-21perl00:33:114
5120719982,5cyclictest1180000-21chrt00:03:396
5120619985,2cyclictest0-21swapper/421:43:124
5120619985,2cyclictest0-21swapper/420:13:164
5120619984,3cyclictest905387-21irqcore22:13:134
5120619984,3cyclictest689996-21tune2fs20:38:094
5120619984,3cyclictest614289-21grep19:58:134
5120619984,3cyclictest543306-21kthreadcore19:18:184
5120619984,3cyclictest1231400-21expr00:28:064
5120619984,3cyclictest1159302-21wc23:58:104
5120619984,3cyclictest1159302-21wc23:58:104
5120619984,3cyclictest1050206-21tune2fs23:13:084
5120619983,4cyclictest933384-21grep22:23:154
5120619983,4cyclictest716559-21cut20:48:184
5120619983,4cyclictest676257-21cut20:28:164
5120619983,4cyclictest577226-21cut19:38:134
5120619983,4cyclictest555274-21fschecks_time19:28:104
5120619983,4cyclictest513064-21if_p4p119:08:114
5120619983,4cyclictest1134563-21cpuspeed_turbos23:48:074
5120619983,4cyclictest1106256-21sed23:33:164
5120619980,7cyclictest848046-21kthreadcore21:48:144
5120619975,1cyclictest0-21swapper/420:58:114
5120619975,1cyclictest0-21swapper/419:48:094
5120619975,1cyclictest0-21swapper/419:48:094
5120619974,2cyclictest808615-21irqcore21:33:124
5120619973,3cyclictest564954-21grep19:33:084
5120619973,3cyclictest524304-21cut19:12:594
5120619973,3cyclictest1183716-21sed00:08:104
5120619973,3cyclictest1123421-21cut23:43:114
5120619973,3cyclictest1062515-21cat23:18:104
5120619973,3cyclictest1013758-21cat22:58:084
5120619972,4cyclictest979006-21cut22:43:144
5120619972,4cyclictest789628-21cut21:23:154
5120619972,4cyclictest1207936-21sed00:18:114
5120619962,3cyclictest1170747-21cat00:03:084
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional