You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-11 - 06:08
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Thu Jun 11, 2026 00:54:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22889973697,423cyclictest0-21swapper/222:09:202
2293996825,2cyclictest0-21swapper/723:38:377
22869967077,126cyclictest0-21swapper/000:21:470
2288996401,381cyclictest0-21swapper/221:57:352
22919962578,417cyclictest0-21swapper/522:06:315
228999623281,339cyclictest704-21nscd21:55:223
22869962227,126cyclictest0-21swapper/021:56:340
228699621110,380cyclictest0-21swapper/022:20:200
22919960656,126cyclictest121rcu_preempt00:38:295
2292995942,383cyclictest0-21swapper/600:23:166
22909959484,507cyclictest64450irq/122-eth023:00:014
2292995931,83cyclictest121rcu_preempt00:12:416
229199593124,253cyclictest0-21swapper/522:05:015
22889958876,211cyclictest33-21ksoftirqd/222:00:512
22909958777,295cyclictest0-21swapper/422:10:154
22879958738,338cyclictest0-21swapper/100:36:261
22919958334,84cyclictest0-21swapper/521:57:485
22869958271,211cyclictest0-21swapper/022:05:030
22879958133,338cyclictest0-21swapper/122:18:291
229099579239,338cyclictest64450irq/122-eth022:04:054
22899957465,84cyclictest0-21swapper/322:48:043
22869957467,126cyclictest0-21swapper/000:13:560
22919957220,168cyclictest1674-21sh22:48:465
22919957122,468cyclictest704-21nscd21:55:005
22919957118,422cyclictest0-21swapper/523:00:125
22899957057,382cyclictest0-21swapper/300:37:483
22919956820,470cyclictest0-21swapper/500:24:285
229399566141,252cyclictest0-21swapper/700:37:307
22919956613,464cyclictest0-21swapper/500:15:035
228699565182,253cyclictest0-21swapper/022:08:020
229299561220,338cyclictest398-21kworker/u16:323:59:276
2287995521,84cyclictest14898-21ssh22:01:031
22879954838,295cyclictest0-21swapper/121:53:551
22879954741,422cyclictest0-21swapper/122:09:281
22919954678,295cyclictest5583-21sh23:59:085
22939954537,126cyclictest0-21swapper/723:00:027
22919954576,338cyclictest0-21swapper/500:40:315
22879954576,338cyclictest0-21swapper/100:31:531
22879954437,338cyclictest0-21swapper/121:55:141
22939954234,169cyclictest0-21swapper/721:56:307
22889954133,126cyclictest0-21swapper/200:31:542
22919954033,504cyclictest0-21swapper/522:16:525
22899953928,84cyclictest0-21swapper/322:02:553
22889953830,169cyclictest0-21swapper/222:58:082
229299537282,84cyclictest641ktimersoftd/600:25:446
22919953734,424cyclictest0-21swapper/523:30:085
22879953729,84cyclictest0-21swapper/122:20:201
228799536156,84cyclictest24047-21which23:00:271
229299534109,126cyclictest65-21ksoftirqd/621:56:256
22919953428,164cyclictest3201-21perl00:15:165
22899953323,508cyclictest0-21swapper/323:00:013
228699533192,338cyclictest2284-21cyclictest00:25:430
228999532193,84cyclictest15821-1kworker/u17:122:17:523
22919953125,342cyclictest0-21swapper/520:04:275
229099530189,338cyclictest64450irq/122-eth000:23:144
22919952918,297cyclictest0-21swapper/500:25:085
228899529149,253cyclictest704-21nscd00:36:262
22879952922,296cyclictest0-21swapper/122:48:441
22919952818,507cyclictest0-21swapper/500:32:055
22909952717,507cyclictest0-21swapper/423:38:374
22879952619,302cyclictest19451-21taskset22:57:581
22889952213,84cyclictest0-21swapper/220:05:092
22899952199,380cyclictest0-21swapper/300:12:353
228799519183,83cyclictest121rcu_preempt20:05:021
2291995176,127cyclictest0-21swapper/523:38:315
2289995177,507cyclictest0-21swapper/323:38:373
2293995156,84cyclictest0-21swapper/722:19:127
2292995157,3cyclictest0-21swapper/623:38:376
2288995154,508cyclictest0-21swapper/223:38:372
22939951045,84cyclictest0-21swapper/722:59:037
2293995090,84cyclictest4474-21perf21:55:027
229299508253,84cyclictest121rcu_preempt22:19:496
22879950838,296cyclictest0-21swapper/123:38:311
2287995081,2cyclictest0-21swapper/100:23:151
22899950579,424cyclictest2284-21cyclictest23:40:053
22899950579,424cyclictest2284-21cyclictest23:40:053
22899950534,297cyclictest0-21swapper/322:05:123
228699503118,211cyclictest6827-21rm22:17:540
229099502121,84cyclictest17068-21ssh23:46:554
22899950275,168cyclictest41-21ksoftirqd/323:59:453
228699502416,84cyclictest111rcuc/022:48:430
22929950174,211cyclictest21102-21ssh22:06:126
22909950176,422cyclictest0-21swapper/400:31:174
228699501164,2cyclictest101ktimersoftd/000:37:240
22889950078,84cyclictest0-21swapper/200:12:162
228699500113,211cyclictest0-21swapper/000:00:070
228699499115,126cyclictest3192-21fschecks_time00:15:150
22909949873,422cyclictest0-21swapper/421:57:004
22909949834,380cyclictest0-21swapper/423:40:274
22909949834,380cyclictest0-21swapper/423:40:274
22919949729,465cyclictest0-21swapper/523:46:445
22909949628,337cyclictest7359-21ssh22:18:404
22909949472,255cyclictest0-21swapper/422:10:014
22939949377,78cyclictest0-21swapper/722:01:047
22909949328,210cyclictest0-21swapper/422:48:084
22889949121,253cyclictest7621-1kworker/u17:222:19:412
22939949025,212cyclictest0-21swapper/700:31:507
22929949064,211cyclictest65-21ksoftirqd/622:48:526
22939948962,212cyclictest73-21ksoftirqd/723:58:577
22879948966,130cyclictest24899-21ssh22:10:151
229299487232,84cyclictest641ktimersoftd/622:57:556
229199486106,295cyclictest2018-1kworker/u17:022:59:335
22909948663,168cyclictest0-21swapper/423:59:484
22909948617,42cyclictest0-21swapper/423:29:454
22889948659,211cyclictest0-21swapper/221:54:522
229399485104,168cyclictest0-21swapper/700:40:177
22869948457,211cyclictest9-21ksoftirqd/023:46:230
229299482229,7cyclictest0-21swapper/600:37:146
22899948216,128cyclictest0-21swapper/320:02:163
22869948259,169cyclictest0-21swapper/022:59:330
22909948012,254cyclictest0-21swapper/421:53:444
22869947751,295cyclictest0-21swapper/021:53:450
2288994744,339cyclictest0-21swapper/200:22:082
22939947191,126cyclictest0-21swapper/722:07:377
228999470132,254cyclictest0-21swapper/321:53:323
2289994697,4cyclictest2284-21cyclictest20:05:113
2286994688,415cyclictest0-21swapper/000:31:090
2293994661,256cyclictest0-21swapper/700:23:157
229099466125,338cyclictest32563-21taskset00:13:094
22899946541,84cyclictest121rcu_preempt00:23:563
22929946483,84cyclictest0-21swapper/621:54:506
228899462122,338cyclictest2284-21cyclictest20:04:362
22869946135,211cyclictest0-21swapper/023:38:300
22879946038,296cyclictest5836-21sh23:59:271
22869946075,211cyclictest0-21swapper/022:10:210
22919945978,84cyclictest0-21swapper/523:40:285
22919945978,84cyclictest0-21swapper/523:40:285
229099459119,337cyclictest0-21swapper/400:25:034
22879945934,338cyclictest0-21swapper/100:14:011
229099457116,338cyclictest0-21swapper/400:38:314
22929945634,256cyclictest0-21swapper/623:47:046
229399455115,338cyclictest0-21swapper/700:13:387
229099455116,337cyclictest0-21swapper/400:00:194
22899945571,211cyclictest0-21swapper/323:46:583
22869945472,380cyclictest0-21swapper/023:00:020
228899453113,338cyclictest0-21swapper/223:00:162
228799453115,84cyclictest0-21swapper/123:40:141
228799453115,84cyclictest0-21swapper/123:40:141
22869945331,211cyclictest0-21swapper/023:58:470
22909945268,169cyclictest0-21swapper/422:59:354
22889945271,126cyclictest0-21swapper/223:59:272
22879945230,295cyclictest0-21swapper/100:25:261
22939945129,211cyclictest17357-21ssh23:47:177
228899451111,338cyclictest0-21swapper/223:46:222
228999450112,84cyclictest0-21swapper/300:40:283
229399449238,3cyclictest32245-21kworker/u16:222:48:437
22899944863,211cyclictest21038-21ssh22:59:203
22889944724,257cyclictest1469-21ssh22:48:282
22899944417,254cyclictest16271-21sh23:30:003
229399441101,337cyclictest0-21swapper/700:25:127
22899944158,126cyclictest0-21swapper/300:31:333
22889944120,337cyclictest0-21swapper/222:10:072
22889944058,338cyclictest0-21swapper/200:25:042
228699440141,126cyclictest121rcu_preempt23:40:200
228699440141,126cyclictest121rcu_preempt23:40:200
229299439319,36cyclictest631rcuc/620:02:586
22929943858,82cyclictest0-21swapper/622:02:586
22899943813,208cyclictest20067-21sshd00:25:143
22889943812,253cyclictest0-21swapper/200:40:302
22939943715,169cyclictest0-21swapper/720:04:377
22919943695,293cyclictest10398-21kworker/u16:023:29:235
22919943614,2cyclictest0-21swapper/522:10:195
22879943513,2cyclictest0-21swapper/123:47:051
22919943253,82cyclictest0-21swapper/522:20:065
2292994275,85cyclictest0-21swapper/600:32:206
2291994261,422cyclictest0-21swapper/500:00:055
22909942686,337cyclictest3314-21runrttasks20:03:024
22889942383,338cyclictest0-21swapper/222:20:072
2287994231,7cyclictest121rcu_preempt23:30:011
22869942343,127cyclictest0-21swapper/020:05:160
229399422166,84cyclictest121rcu_preempt22:10:207
22879942180,338cyclictest0-21swapper/100:40:281
22869942183,84cyclictest0-21swapper/000:40:400
22939942079,338cyclictest0-21swapper/700:00:207
22929942081,84cyclictest0-21swapper/600:40:296
22889942080,338cyclictest0-21swapper/223:29:592
22939941978,338cyclictest0-21swapper/723:30:097
22889941978,338cyclictest0-21swapper/200:15:072
22879941939,177cyclictest0-21swapper/120:05:091
229299418119,126cyclictest65-21ksoftirqd/600:15:076
22889941878,338cyclictest0-21swapper/200:00:192
22939941776,338cyclictest0-21swapper/723:29:227
22889941776,338cyclictest0-21swapper/223:40:052
22889941776,338cyclictest0-21swapper/223:40:052
22869941779,84cyclictest0-21swapper/020:02:150
22909941677,336cyclictest0-21swapper/400:40:284
22929941534,169cyclictest0-21swapper/623:00:296
22909941535,296cyclictest3221-21grep00:15:174
22899941575,338cyclictest0-21swapper/300:15:163
22879941575,338cyclictest0-21swapper/100:15:171
22879941574,338cyclictest0-21swapper/100:00:181
22899941333,296cyclictest0-21swapper/322:10:073
22879941333,296cyclictest0-21swapper/123:30:071
22929941273,84cyclictest0-21swapper/623:40:116
22929941273,84cyclictest0-21swapper/623:40:116
229299412323,87cyclictest641ktimersoftd/622:20:146
22909941272,337cyclictest0-21swapper/422:20:064
22869941273,84cyclictest0-21swapper/023:30:090
22939941170,338cyclictest0-21swapper/723:40:077
22939941170,338cyclictest0-21swapper/723:40:077
22919941071,84cyclictest0-21swapper/520:05:165
228999408113,84cyclictest121rcu_preempt22:20:093
22899940767,338cyclictest0-21swapper/300:00:203
22889940626,296cyclictest0-21swapper/223:30:072
22929940566,84cyclictest0-21swapper/600:00:076
22939940261,338cyclictest0-21swapper/720:05:097
229399402102,126cyclictest0-21swapper/700:15:167
22939939757,338cyclictest0-21swapper/722:20:067
2292993888,256cyclictest0-21swapper/622:10:196
22929938086,42cyclictest16299-21rm23:30:016
22909937983,84cyclictest0-21swapper/423:30:144
22929937534,85cyclictest0-21swapper/620:05:176
22899937433,338cyclictest0-21swapper/323:30:063
229099368112,253cyclictest3826-21chrt20:05:054
22869935459,133cyclictest0-21swapper/023:30:010
2292993401,42cyclictest0-21swapper/623:30:066
174328454,27sleep10-21swapper/119:08:241
154028453,28sleep60-21swapper/619:05:406
117128479,2sleep50-21swapper/519:05:225
172728352,28sleep30-21swapper/319:08:093
152328243,35sleep00-21swapper/019:05:250
167728147,30sleep20-21swapper/219:07:282
159528149,28sleep70-21swapper/719:06:227
156228150,27sleep40-21swapper/419:05:544
137802730,0sleep70-21swapper/723:11:377
2291995621,31cyclictest3656-21tr22:50:135
2291994620,22cyclictest20865-21cat23:50:125
2287994511,31cyclictest3674-21expr22:50:131
2287994019,17cyclictest23256-21taskset23:50:301
229399371,33cyclictest0-21swapper/722:50:217
229299372,5cyclictest3726-21grep22:50:136
228899372,4cyclictest0-21swapper/222:50:062
228699377,14cyclictest9-21ksoftirqd/023:50:210
229299362,31cyclictest0-21swapper/623:50:026
2290993629,4cyclictest0-21swapper/422:50:024
228699362,3cyclictest3493-21apt-get22:50:120
2291993310,17cyclictest0-21swapper/521:43:455
228999331,30cyclictest0-21swapper/322:50:033
228899331,29cyclictest0-21swapper/223:50:142
229399321,28cyclictest0-21swapper/723:50:057
2287993225,6cyclictest0-21swapper/122:43:301
2290993123,5cyclictest20964-21tr23:50:134
228999311,27cyclictest0-21swapper/323:50:153
2291993024,6cyclictest0-21swapper/522:43:305
2291992926,3cyclictest0-21swapper/520:21:015
2289992927,1cyclictest0-21swapper/320:50:203
2287992926,2cyclictest0-21swapper/119:29:081
2293992828,0cyclictest0-21swapper/719:28:387
2293992810,18cyclictest0-21swapper/721:43:317
2293992810,18cyclictest0-21swapper/721:31:167
2293992810,18cyclictest0-21swapper/721:14:277
2293992810,18cyclictest0-21swapper/720:50:407
2293992810,18cyclictest0-21swapper/719:39:467
2293992810,18cyclictest0-21swapper/719:20:327
2293992810,0cyclictest0-21swapper/722:43:567
2292992828,0cyclictest0-21swapper/621:31:286
2292992810,18cyclictest0-21swapper/619:14:016
2291992825,3cyclictest0-21swapper/520:42:185
2290992810,17cyclictest0-21swapper/421:43:254
2289992810,18cyclictest0-21swapper/321:31:293
2288992810,18cyclictest0-21swapper/222:43:372
2288992810,0cyclictest0-21swapper/221:14:492
2287992826,2cyclictest0-21swapper/120:21:031
2286992810,18cyclictest0-21swapper/021:43:400
2293992727,0cyclictest0-21swapper/720:31:547
2293992710,17cyclictest0-21swapper/719:48:357
2293992710,0cyclictest0-21swapper/721:01:547
2293992710,0cyclictest0-21swapper/720:21:137
2292992727,0cyclictest0-21swapper/620:50:476
2292992710,17cyclictest0-21swapper/622:43:356
2292992710,17cyclictest0-21swapper/620:31:536
2292992710,17cyclictest0-21swapper/619:28:406
2292992710,0cyclictest0-21swapper/621:43:076
2292992710,0cyclictest0-21swapper/621:14:236
2292992710,0cyclictest0-21swapper/621:01:506
2292992710,0cyclictest0-21swapper/620:42:176
2292992710,0cyclictest0-21swapper/620:21:116
2292992710,0cyclictest0-21swapper/619:48:426
2292992710,0cyclictest0-21swapper/619:20:416
2291992727,0cyclictest0-21swapper/521:31:055
2291992726,1cyclictest0-21swapper/519:28:585
2291992710,17cyclictest0-21swapper/521:14:325
2291992710,17cyclictest0-21swapper/520:31:565
2291992710,17cyclictest0-21swapper/519:20:335
2291992710,0cyclictest0-21swapper/520:50:395
2291992710,0cyclictest0-21swapper/519:49:035
2290992710,17cyclictest0-21swapper/422:43:314
2290992710,17cyclictest0-21swapper/421:31:034
2290992710,17cyclictest0-21swapper/421:01:544
2290992710,17cyclictest0-21swapper/420:50:374
2290992710,17cyclictest0-21swapper/420:42:304
2290992710,17cyclictest0-21swapper/420:21:044
2290992710,17cyclictest0-21swapper/419:48:424
2290992710,17cyclictest0-21swapper/419:28:474
2290992710,17cyclictest0-21swapper/419:20:304
2290992710,17cyclictest0-21swapper/419:14:044
2290992710,0cyclictest0-21swapper/421:14:304
2290992710,0cyclictest0-21swapper/420:31:534
2289992727,0cyclictest0-21swapper/322:43:363
2289992710,17cyclictest0-21swapper/321:43:143
2289992710,17cyclictest0-21swapper/321:14:303
2289992710,17cyclictest0-21swapper/319:49:023
2289992710,0cyclictest0-21swapper/320:42:163
2289992710,0cyclictest0-21swapper/319:21:073
2288992727,0cyclictest0-21swapper/219:14:032
2288992710,17cyclictest0-21swapper/221:31:162
2288992710,17cyclictest0-21swapper/220:42:232
2288992710,17cyclictest0-21swapper/220:31:512
2288992710,17cyclictest0-21swapper/220:21:002
2288992710,17cyclictest0-21swapper/219:48:372
2288992710,17cyclictest0-21swapper/219:39:422
2288992710,17cyclictest0-21swapper/219:28:552
2288992710,0cyclictest0-21swapper/221:43:142
2288992710,0cyclictest0-21swapper/220:50:462
2288992710,0cyclictest0-21swapper/219:20:322
2287992710,17cyclictest0-21swapper/121:31:051
2287992710,17cyclictest0-21swapper/121:14:291
2287992710,17cyclictest0-21swapper/120:50:321
2287992710,17cyclictest0-21swapper/120:42:231
2287992710,17cyclictest0-21swapper/119:48:481
2287992710,17cyclictest0-21swapper/119:20:141
2287992710,0cyclictest0-21swapper/121:43:041
2287992710,0cyclictest0-21swapper/119:14:121
2286992727,0cyclictest0-21swapper/022:43:230
2286992710,17cyclictest0-21swapper/021:30:500
2286992710,17cyclictest0-21swapper/021:14:210
2286992710,17cyclictest0-21swapper/020:50:340
2286992710,17cyclictest0-21swapper/019:48:380
2286992710,0cyclictest0-21swapper/021:01:510
2286992710,0cyclictest0-21swapper/020:42:240
2286992710,0cyclictest0-21swapper/020:31:510
2286992710,0cyclictest0-21swapper/020:21:280
2286992710,0cyclictest0-21swapper/019:39:390
2286992710,0cyclictest0-21swapper/019:28:350
2286992710,0cyclictest0-21swapper/019:20:140
2286992710,0cyclictest0-21swapper/019:14:000
2293992626,0cyclictest0-21swapper/719:14:067
2292992626,0cyclictest0-21swapper/619:39:376
2291992626,0cyclictest0-21swapper/519:39:485
2291992626,0cyclictest0-21swapper/519:14:105
2290992626,0cyclictest0-21swapper/419:39:434
2289992626,0cyclictest0-21swapper/319:28:493
2289992626,0cyclictest0-21swapper/319:14:003
2288992610,16cyclictest0-21swapper/221:01:512
2293992525,0cyclictest0-21swapper/720:42:197
2291992525,0cyclictest0-21swapper/521:01:455
2287992525,0cyclictest0-21swapper/121:01:581
2287992525,0cyclictest0-21swapper/119:39:351
252022240,1sleep70-21swapper/721:16:367
2293992424,0cyclictest0-21swapper/719:40:017
2289992424,0cyclictest0-21swapper/321:01:483
2289992424,0cyclictest0-21swapper/320:21:023
2289992423,0cyclictest0-21swapper/319:39:463
2287992424,0cyclictest0-21swapper/120:32:041
300832200,0sleep10-21swapper/119:55:001
229299200,2cyclictest414-21basename20:00:016
229399190,18cyclictest0-21swapper/722:37:227
228799199,9cyclictest9896-21diskmemload21:46:111
228799199,9cyclictest9623-21expr21:25:111
228799198,10cyclictest31726-21chrt22:30:251
228799198,10cyclictest31726-21chrt22:30:251
2287991917,1cyclictest0-21swapper/123:20:161
2291991810,8cyclictest0-21swapper/519:59:575
2290991810,8cyclictest0-21swapper/419:40:014
228799189,8cyclictest22585-21tr21:15:191
228799189,8cyclictest17428-21proc_pri20:25:191
228799187,10cyclictest2710-21ssh21:21:211
228799187,10cyclictest19491-21sh00:05:381
2287991810,7cyclictest27903-21ssh22:29:381
2287991810,0cyclictest0-21swapper/120:00:001
2286991810,8cyclictest0-21swapper/020:00:010
228999170,17cyclictest0-21swapper/320:31:523
228799178,8cyclictest0-21swapper/123:06:291
228799176,10cyclictest26770-21ssh23:18:391
228799171,15cyclictest0-21swapper/122:39:411
228699173,7cyclictest8856-21latency_hist23:10:000
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional