You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-12 - 03:10
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Sun Jul 12, 2026 00:55:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1975599792113,634cyclictest0-21swapper/200:11:352
197559971435,676cyclictest23531-21ssh00:03:162
1975499700269,296cyclictest27531-21diskmemload22:53:261
197539970023,211cyclictest0-21swapper/000:11:350
19755996898,507cyclictest0-21swapper/200:32:282
1975599677124,84cyclictest0-21swapper/200:20:592
197559967133,635cyclictest0-21swapper/223:12:342
197599964953,380cyclictest0-21swapper/622:17:366
197549962875,380cyclictest0-21swapper/100:03:341
197589962067,380cyclictest0-21swapper/523:57:035
1975899610100,507cyclictest0-21swapper/522:06:315
1975899605224,126cyclictest561ktimersoftd/500:01:545
19755996036,508cyclictest0-21swapper/223:37:372
197549960310,126cyclictest27945-21kworker/u16:122:43:131
197589960250,380cyclictest0-21swapper/522:21:595
19757996027,295cyclictest0-21swapper/400:04:304
19756995980,84cyclictest0-21swapper/322:22:503
197579959686,507cyclictest0-21swapper/421:58:114
197579959686,507cyclictest0-21swapper/421:58:114
197579959686,507cyclictest0-21swapper/421:58:114
197579959686,507cyclictest0-21swapper/421:58:104
19757995930,84cyclictest0-21swapper/422:06:504
19754995930,84cyclictest0-21swapper/100:24:051
197599959180,296cyclictest0-21swapper/623:20:206
1975899591334,48cyclictest0-21swapper/500:06:285
1975699591122,295cyclictest121rcu_preempt23:38:303
197559959080,507cyclictest0-21swapper/200:06:592
197559958675,508cyclictest0-21swapper/220:00:062
1975599586117,258cyclictest0-21swapper/219:59:262
1975599586117,258cyclictest0-21swapper/219:59:262
1975599585155,428cyclictest0-21swapper/222:22:592
1975599583115,465cyclictest23969-21ssh00:44:162
197579957967,83cyclictest0-21swapper/400:05:234
197539957872,84cyclictest0-21swapper/022:24:540
197559956960,126cyclictest0-21swapper/221:58:102
197559956960,126cyclictest0-21swapper/221:58:102
197559956960,126cyclictest0-21swapper/221:58:102
197559956960,126cyclictest0-21swapper/221:58:102
1975599569101,83cyclictest0-21swapper/222:06:572
197569956599,211cyclictest0-21swapper/323:14:183
197599956351,508cyclictest0-21swapper/621:58:106
197599956351,508cyclictest0-21swapper/621:58:106
197599956351,508cyclictest0-21swapper/621:58:106
197599956351,508cyclictest0-21swapper/621:58:106
197589956111,126cyclictest0-21swapper/523:14:175
197569956150,508cyclictest0-21swapper/321:58:103
197569956150,508cyclictest0-21swapper/321:58:103
197569956150,508cyclictest0-21swapper/321:58:103
197569956150,508cyclictest0-21swapper/321:58:103
197539956193,465cyclictest0-21swapper/000:01:530
197579956093,253cyclictest0-21swapper/400:43:064
19755995596,169cyclictest0-21swapper/222:52:402
197609955850,126cyclictest0-21swapper/721:58:107
197609955850,126cyclictest0-21swapper/721:58:107
197609955850,126cyclictest0-21swapper/721:58:107
197609955850,126cyclictest0-21swapper/721:58:107
197589955143,126cyclictest0-21swapper/521:58:105
197589955143,126cyclictest0-21swapper/521:58:105
197589955143,126cyclictest0-21swapper/521:58:105
197589955143,126cyclictest0-21swapper/521:58:105
1975399548121,296cyclictest4222-21sshd23:50:330
197599954777,296cyclictest0-21swapper/600:11:556
1975799547375,169cyclictest481ktimersoftd/423:27:594
1975799547375,169cyclictest481ktimersoftd/423:27:594
1975799547207,338cyclictest19751-21cyclictest19:25:164
197559954781,211cyclictest0-21swapper/222:19:252
1975799546502,41cyclictest471rcuc/400:11:484
197569954576,211cyclictest41-21ksoftirqd/300:32:283
1975899544164,127cyclictest121rcu_preempt00:32:115
1976099543202,338cyclictest15850irq/123-ahci[0000:09:157
1976099543162,339cyclictest19751-21cyclictest23:46:497
1975999542119,84cyclictest0-21swapper/600:04:346
197559954132,127cyclictest0-21swapper/219:25:332
1975599541285,254cyclictest321ktimersoftd/222:55:242
197599954032,338cyclictest0-21swapper/623:50:016
1975799537195,211cyclictest5678-21cstates23:15:154
197599953624,339cyclictest0-21swapper/619:58:406
197599953624,339cyclictest0-21swapper/619:58:396
197559953626,126cyclictest0-21swapper/220:50:072
197559953625,508cyclictest0-21swapper/223:58:482
197609953566,297cyclictest0-21swapper/722:54:337
197599953566,381cyclictest0-21swapper/600:24:006
1975499534193,338cyclictest2693-21rm00:11:281
1975699531149,84cyclictest121rcu_preempt23:59:073
197539953162,211cyclictest0-21swapper/022:00:030
197539953162,211cyclictest0-21swapper/022:00:030
1975999530108,85cyclictest0-21swapper/622:21:326
1975399530190,337cyclictest30186-21nscd22:18:480
197589952921,84cyclictest0-21swapper/523:28:465
197589952921,84cyclictest0-21swapper/523:28:465
1975799529190,337cyclictest64450irq/122-eth023:49:294
197539952818,126cyclictest0-21swapper/023:30:260
1976099527100,424cyclictest10841-21ssh22:06:317
197609952661,84cyclictest0-21swapper/722:21:337
197559952515,126cyclictest0-21swapper/222:25:112
1976099524441,3cyclictest711rcuc/700:24:337
197609952416,126cyclictest0-21swapper/700:14:357
197589952417,256cyclictest0-21swapper/500:43:415
1975399521137,169cyclictest704-21nscd23:37:140
1976099519436,3cyclictest711rcuc/700:44:537
1975399519221,126cyclictest0-21swapper/023:49:480
197539951911,126cyclictest0-21swapper/000:08:540
197569951892,126cyclictest0-21swapper/323:05:483
197579951711,84cyclictest0-21swapper/422:54:184
19759995169,7cyclictest0-21swapper/623:37:186
19757995154,126cyclictest0-21swapper/400:32:264
19754995148,84cyclictest0-21swapper/100:34:311
1976099511170,338cyclictest19751-21cyclictest23:28:477
1976099511170,338cyclictest19751-21cyclictest23:28:477
1975899511338,84cyclictest0-21swapper/522:43:435
1975699510337,42cyclictest22277-21chrt00:42:253
19756995100,84cyclictest0-21swapper/322:06:493
19758995091,126cyclictest0-21swapper/500:14:355
197569950982,211cyclictest27531-21diskmemload23:29:383
197569950982,211cyclictest27531-21diskmemload23:29:383
197569950982,211cyclictest0-21swapper/320:48:453
197569950981,296cyclictest0-21swapper/322:18:213
19756995090,84cyclictest0-21swapper/322:43:413
197559950985,84cyclictest0-21swapper/220:49:172
1975999508124,84cyclictest121rcu_preempt00:42:136
19757995080,84cyclictest0-21swapper/422:43:414
1975399508252,126cyclictest0-21swapper/022:00:130
1975399508167,127cyclictest0-21swapper/023:27:170
1975399508167,127cyclictest0-21swapper/023:27:170
197579950783,254cyclictest64450irq/122-eth023:30:174
197569950782,208cyclictest0-21swapper/322:00:063
1975599507124,84cyclictest0-21swapper/223:05:282
197609950683,84cyclictest0-21swapper/720:00:137
1975999506123,380cyclictest0-21swapper/622:51:486
197539950638,295cyclictest30921-21ssh22:53:390
1975799505422,3cyclictest481ktimersoftd/423:58:554
197549950578,211cyclictest0-21swapper/120:07:021
1975599504162,126cyclictest121rcu_preempt23:28:262
1975599504162,126cyclictest121rcu_preempt23:28:252
1975499504123,211cyclictest0-21swapper/122:00:081
197609950334,466cyclictest0-21swapper/722:19:387
1975699503122,175cyclictest41-21ksoftirqd/300:21:303
1975399503419,4cyclictest111rcuc/023:58:550
197539950334,211cyclictest9-21ksoftirqd/000:35:030
1975699502118,211cyclictest27531-21diskmemload00:08:543
197549950274,254cyclictest121rcu_preempt00:06:571
197539950233,380cyclictest0-21swapper/022:55:210
1975699501202,126cyclictest0-21swapper/323:49:483
19758995000,331cyclictest0-21swapper/523:48:205
197579950077,126cyclictest0-21swapper/422:20:504
197589949976,84cyclictest0-21swapper/520:00:135
197579949978,255cyclictest0-21swapper/400:22:534
197599949875,126cyclictest30628-21sh23:46:296
1975699498115,381cyclictest0-21swapper/300:01:533
1976099497114,380cyclictest27531-21diskmemload00:01:537
197599949771,211cyclictest0-21swapper/600:09:146
1975999497116,84cyclictest0-21swapper/623:05:286
197589949731,211cyclictest0-21swapper/522:55:245
197559949728,127cyclictest12261-21ssh22:42:342
1975499497113,126cyclictest0-21swapper/123:56:571
197539949774,211cyclictest0-21swapper/000:20:410
1976099496239,254cyclictest721ktimersoftd/723:39:127
197589949631,211cyclictest0-21swapper/500:24:335
197579949673,84cyclictest0-21swapper/423:12:324
1975399496113,380cyclictest27287-21ssh21:58:200
1975399496113,380cyclictest27287-21ssh21:58:200
197539949573,84cyclictest0-21swapper/023:14:330
197599949425,212cyclictest0-21swapper/623:30:296
197549949467,338cyclictest0-21swapper/120:49:171
197569949366,211cyclictest41-21ksoftirqd/319:59:243
197569949366,211cyclictest41-21ksoftirqd/319:59:243
197559949325,465cyclictest0-21swapper/223:46:272
197599949223,295cyclictest0-21swapper/623:59:456
197559949128,79cyclictest0-21swapper/223:30:142
197589948967,84cyclictest0-21swapper/500:25:215
197589948967,84cyclictest0-21swapper/500:25:215
197539948966,126cyclictest0-21swapper/019:59:270
197539948966,126cyclictest0-21swapper/019:59:260
1976099488445,3cyclictest711rcuc/723:56:337
197589948867,126cyclictest0-21swapper/522:18:125
197539948866,84cyclictest0-21swapper/019:25:360
1976099487404,3cyclictest711rcuc/722:43:217
197589948620,211cyclictest0-21swapper/519:59:405
197589948620,211cyclictest0-21swapper/519:59:405
197549948660,211cyclictest0-21swapper/122:18:281
197609948517,465cyclictest0-21swapper/722:55:077
197539948516,211cyclictest0-21swapper/020:45:520
197609948462,84cyclictest0-21swapper/723:14:347
197609948462,256cyclictest21846-21chrt23:05:287
197589948457,211cyclictest0-21swapper/523:50:135
1976099483101,127cyclictest13829-1kworker/7:0H20:45:527
1975999483101,127cyclictest0-21swapper/622:06:316
1975899482144,84cyclictest14384-21rm23:37:155
197559948215,126cyclictest4219-21ssh23:50:332
197559948213,296cyclictest0-21swapper/222:45:022
197559948213,296cyclictest0-21swapper/222:45:022
1975799481226,253cyclictest481ktimersoftd/422:18:464
197579948059,126cyclictest0-21swapper/422:25:244
197549948097,380cyclictest0-21swapper/122:06:311
197579947957,84cyclictest0-21swapper/420:00:134
197549947913,84cyclictest0-21swapper/123:15:141
1975399479184,48cyclictest27531-21diskmemload22:25:210
197609947856,84cyclictest0-21swapper/700:25:227
197609947856,84cyclictest0-21swapper/700:25:217
197599947755,3cyclictest13976-21ssh22:44:346
197599947754,176cyclictest22140-21/usr/sbin/munin00:25:216
197599947754,176cyclictest22140-21/usr/sbin/munin00:25:216
197549947710,127cyclictest0-21swapper/123:30:281
197549947610,126cyclictest0-21swapper/123:14:411
197579947493,257cyclictest64450irq/122-eth023:37:184
1975499474134,126cyclictest121rcu_preempt22:21:321
19760994723,338cyclictest1553-21runrttasks00:15:077
197559947012,160cyclictest0-21swapper/222:00:132
19754994701,211cyclictest0-21swapper/123:47:111
197589946846,84cyclictest0-21swapper/522:25:145
1975399468127,126cyclictest121rcu_preempt23:05:200
197599946740,254cyclictest0-21swapper/623:28:346
197599946740,254cyclictest0-21swapper/623:28:346
197589946685,296cyclictest19751-21cyclictest22:54:175
1975599466124,339cyclictest0-21swapper/220:07:102
19754994660,84cyclictest0-21swapper/123:27:131
19754994660,84cyclictest0-21swapper/123:27:131
19754994660,48cyclictest0-21swapper/123:37:381
197539946683,126cyclictest9-21ksoftirqd/022:06:480
19753994660,84cyclictest27852-21seq20:15:120
1976099465125,338cyclictest9260-21kworker/u16:223:20:277
1975799465124,338cyclictest0-21swapper/423:05:174
197609946483,378cyclictest0-21swapper/722:25:127
1975999463124,84cyclictest0-21swapper/622:25:116
1975999463124,84cyclictest0-21swapper/621:15:256
1975999463123,84cyclictest0-21swapper/620:47:136
1975599463124,84cyclictest0-21swapper/200:35:242
1975399463123,337cyclictest0-21swapper/000:15:210
1975399463122,338cyclictest0-21swapper/022:43:010
1976099462121,338cyclictest4500-21taskset00:32:097
197579946278,211cyclictest0-21swapper/422:00:204
197569946240,256cyclictest0-21swapper/323:30:233
1975699462123,337cyclictest0-21swapper/320:15:123
1975599462122,84cyclictest0-21swapper/223:15:172
1975399462120,126cyclictest121rcu_preempt00:42:030
1975999461122,84cyclictest0-21swapper/600:35:026
197569946181,296cyclictest0-21swapper/322:25:153
197609946078,84cyclictest0-21swapper/723:40:177
1975999459118,339cyclictest0-21swapper/600:35:106
1975999459118,127cyclictest65-21ksoftirqd/623:12:436
197569945979,296cyclictest0-21swapper/300:15:123
197559945934,423cyclictest0-21swapper/223:40:302
1975599459120,84cyclictest5823-21ssh00:15:062
197609945875,380cyclictest0-21swapper/723:30:177
1976099458117,338cyclictest0-21swapper/719:25:167
197549945836,2cyclictest0-21swapper/121:58:011
197549945836,2cyclictest0-21swapper/121:58:011
197549945836,2cyclictest0-21swapper/121:58:011
197549945836,2cyclictest0-21swapper/121:58:011
1975799457117,337cyclictest0-21swapper/420:50:214
1975599457116,338cyclictest0-21swapper/221:15:272
1975399457116,338cyclictest17345-21rm23:20:240
197599945628,254cyclictest0-21swapper/623:40:176
197579945632,85cyclictest0-21swapper/421:39:464
1975999455114,338cyclictest0-21swapper/620:07:116
1975599455115,338cyclictest0-21swapper/220:15:172
197589945472,87cyclictest0-21swapper/522:00:085
197579945474,84cyclictest0-21swapper/423:50:204
1975799454114,338cyclictest0-21swapper/419:58:194
1975799454114,338cyclictest0-21swapper/419:58:184
197549945428,210cyclictest0-21swapper/119:58:061
197549945428,210cyclictest0-21swapper/119:58:061
1975999453112,338cyclictest0-21swapper/619:25:156
197599945225,295cyclictest0-21swapper/619:14:246
1975999452112,84cyclictest0-21swapper/620:00:056
197569945230,84cyclictest0-21swapper/319:14:243
197549945225,168cyclictest21468-21sh23:05:221
1975999451112,84cyclictest0-21swapper/623:15:176
197559945126,295cyclictest1551-21snmpd19:14:322
1975599451193,126cyclictest121rcu_preempt00:25:262
1975599451193,126cyclictest121rcu_preempt00:25:262
1975999448107,211cyclictest0-21swapper/622:45:026
1975999448107,211cyclictest0-21swapper/622:45:026
197609944767,84cyclictest0-21swapper/723:50:317
1975899447149,126cyclictest121rcu_preempt20:48:265
1975799447106,127cyclictest49-21ksoftirqd/400:35:104
1975399447106,338cyclictest0-21swapper/023:15:100
197589944624,3cyclictest0-21swapper/523:30:195
197589944623,169cyclictest0-21swapper/519:14:425
1975499446407,37cyclictest231rcuc/122:45:051
1975499446407,37cyclictest231rcuc/122:45:051
197539944662,126cyclictest121rcu_preempt20:07:030
197579944522,126cyclictest64450irq/122-eth000:15:184
197569944459,211cyclictest0-21swapper/322:45:193
197569944459,211cyclictest0-21swapper/322:45:193
1975699444102,126cyclictest41-21ksoftirqd/319:25:333
1975399444103,338cyclictest0-21swapper/019:32:390
197599944316,211cyclictest0-21swapper/600:15:056
1975999442143,126cyclictest121rcu_preempt22:00:086
197579944262,84cyclictest0-21swapper/420:48:034
197569944228,118cyclictest0-21swapper/322:54:583
197549944221,255cyclictest0-21swapper/123:50:091
197549944118,253cyclictest241ktimersoftd/119:25:151
1976099440403,2cyclictest711rcuc/719:56:387
1976099440403,2cyclictest711rcuc/719:56:387
197569944018,3cyclictest0-21swapper/323:50:033
197569943916,169cyclictest41-21ksoftirqd/300:12:343
197549943958,126cyclictest0-21swapper/100:42:041
197549943917,256cyclictest0-21swapper/100:15:031
197609943795,126cyclictest5663-21ls23:15:157
1975499436182,84cyclictest241ktimersoftd/100:35:071
197549943614,211cyclictest0-21swapper/120:50:231
1975499436137,126cyclictest121rcu_preempt00:25:271
1975499436137,126cyclictest121rcu_preempt00:25:271
197569943512,257cyclictest0-21swapper/323:15:043
197589943412,176cyclictest0-21swapper/519:25:335
1975399433388,42cyclictest101ktimersoftd/000:35:100
19758994292,211cyclictest7513-21ssh00:35:115
197599942583,339cyclictest0-21swapper/620:50:036
197589942546,84cyclictest0-21swapper/523:40:255
19757994251,84cyclictest0-21swapper/421:15:264
1975499425124,170cyclictest0-21swapper/120:29:501
197539942585,82cyclictest121rcu_preempt00:25:270
197539942585,82cyclictest121rcu_preempt00:25:270
197599942487,335cyclictest0-21swapper/620:15:236
197569942483,338cyclictest0-21swapper/322:55:083
197549942440,210cyclictest25-21ksoftirqd/123:40:141
19753994240,84cyclictest30531-21missed_timers22:35:200
19753994240,84cyclictest0-21swapper/020:00:050
19760994231,255cyclictest0-21swapper/722:00:227
19758994231,2cyclictest0-21swapper/500:15:105
197569942383,338cyclictest0-21swapper/300:35:253
197539942382,338cyclictest0-21swapper/021:32:300
197539942382,338cyclictest0-21swapper/019:14:360
197609942283,84cyclictest0-21swapper/720:15:127
197609942283,84cyclictest0-21swapper/700:35:257
197599942281,338cyclictest0-21swapper/622:35:186
197579942282,337cyclictest0-21swapper/422:45:204
197579942282,337cyclictest0-21swapper/422:45:204
1975999421124,84cyclictest0-21swapper/621:32:306
197589942081,84cyclictest0-21swapper/520:50:215
197589942081,84cyclictest0-21swapper/520:15:135
197549942080,338cyclictest0-21swapper/122:25:131
197539942079,338cyclictest0-21swapper/020:50:140
197539942078,339cyclictest0-21swapper/022:45:200
197539942078,339cyclictest0-21swapper/022:45:190
197609941877,338cyclictest0-21swapper/721:39:457
197589941880,83cyclictest0-21swapper/522:45:025
197589941880,83cyclictest0-21swapper/522:45:025
197569941878,338cyclictest0-21swapper/320:50:223
197559941879,84cyclictest0-21swapper/223:20:212
197549941878,338cyclictest0-21swapper/122:55:251
197609941778,84cyclictest0-21swapper/722:45:057
197609941778,84cyclictest0-21swapper/722:45:057
197609941776,338cyclictest0-21swapper/720:07:027
197599941676,338cyclictest0-21swapper/622:55:086
197579941677,84cyclictest0-21swapper/423:20:244
197569941676,338cyclictest0-21swapper/320:07:103
197559941675,338cyclictest0-21swapper/222:35:192
197589941577,84cyclictest0-21swapper/521:39:395
197549941534,87cyclictest0-21swapper/120:15:181
197599941374,84cyclictest0-21swapper/619:32:396
197589941374,84cyclictest0-21swapper/519:32:395
197579941375,84cyclictest0-21swapper/420:15:124
1975899412112,127cyclictest0-21swapper/523:15:145
197579941232,42cyclictest0-21swapper/419:14:434
197539941273,84cyclictest0-21swapper/021:39:390
197609941169,339cyclictest0-21swapper/720:50:147
197549941170,338cyclictest0-21swapper/119:14:361
197609941029,292cyclictest0-21swapper/719:14:477
197579941072,84cyclictest0-21swapper/422:55:084
197609940929,296cyclictest0-21swapper/721:15:337
197569940929,256cyclictest0-21swapper/323:40:183
197579940869,84cyclictest0-21swapper/423:40:304
197609940770,83cyclictest0-21swapper/719:32:377
197589940768,84cyclictest0-21swapper/523:20:215
197549940665,338cyclictest0-21swapper/123:20:211
1975499406107,88cyclictest121rcu_preempt21:15:231
197569940566,337cyclictest0-21swapper/323:20:243
197549940565,338cyclictest0-21swapper/120:00:051
1975499403105,295cyclictest30443-21ssh22:35:171
197589940261,211cyclictest21749-21ssh23:05:255
197579940263,84cyclictest0-21swapper/420:07:104
197569940261,338cyclictest0-21swapper/300:25:233
197569940261,338cyclictest0-21swapper/300:25:233
197609940160,338cyclictest0-21swapper/722:35:187
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional