You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-23 - 17:34
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Tue Jun 23, 2026 12:54:56)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
113999971031,676cyclictest0-21swapper/411:16:374
113999971031,676cyclictest0-21swapper/411:16:374
113999966531,503cyclictest0-21swapper/411:44:384
11399996459,633cyclictest0-21swapper/410:03:314
11399996459,633cyclictest0-21swapper/410:03:314
113999962833,549cyclictest704-21nscd11:51:154
1140299623540,3cyclictest721ktimersoftd/711:34:167
1140299623540,3cyclictest721ktimersoftd/711:34:167
113999962333,509cyclictest0-21swapper/409:17:364
113999962235,463cyclictest0-21swapper/411:33:534
113999962235,463cyclictest0-21swapper/411:33:534
1139599613102,211cyclictest101ktimersoftd/011:34:130
1139599613102,211cyclictest101ktimersoftd/011:34:130
113969960394,126cyclictest0-21swapper/109:29:211
11397995950,84cyclictest0-21swapper/212:15:012
11402995940,84cyclictest0-21swapper/710:40:007
113999958836,549cyclictest0-21swapper/409:36:364
113999958734,550cyclictest64450irq/122-eth010:16:534
113969958778,126cyclictest0-21swapper/111:34:071
113969958778,126cyclictest0-21swapper/111:34:061
1139599580111,296cyclictest0-21swapper/009:29:210
1139799575491,4cyclictest321ktimersoftd/211:33:552
1139799575491,4cyclictest321ktimersoftd/211:33:552
114019956814,211cyclictest0-21swapper/610:03:126
114019956814,211cyclictest0-21swapper/610:03:126
113999956815,549cyclictest0-21swapper/411:08:234
113999956815,549cyclictest0-21swapper/411:08:234
113969954735,127cyclictest0-21swapper/109:36:391
1139799545501,42cyclictest311rcuc/209:26:582
113999954033,425cyclictest0-21swapper/412:14:304
1139899540456,3cyclictest391rcuc/310:49:593
113979953969,381cyclictest0-21swapper/210:48:562
1139799539500,3cyclictest321ktimersoftd/211:16:402
1139799539500,3cyclictest321ktimersoftd/211:16:392
113959953933,168cyclictest0-21swapper/008:11:560
113999953226,337cyclictest0-21swapper/409:40:104
113979953262,211cyclictest0-21swapper/209:36:572
113959953224,380cyclictest0-21swapper/011:16:120
113959953224,380cyclictest0-21swapper/011:16:110
1140099531488,41cyclictest551rcuc/511:33:005
1140099531488,41cyclictest551rcuc/511:33:005
113999952919,507cyclictest0-21swapper/410:39:054
113979952619,127cyclictest0-21swapper/211:07:412
113979952619,127cyclictest0-21swapper/211:07:412
113959952559,126cyclictest0-21swapper/010:49:190
113989952253,211cyclictest14270-21ssh12:15:023
114009951916,287cyclictest0-21swapper/510:05:045
114009951916,287cyclictest0-21swapper/510:05:035
1139599519181,172cyclictest101ktimersoftd/011:07:410
1139599519181,172cyclictest101ktimersoftd/011:07:410
113999951550,124cyclictest0-21swapper/409:29:224
11401995141,296cyclictest0-21swapper/612:11:086
11400995123,506cyclictest0-21swapper/509:28:495
11399995111,127cyclictest0-21swapper/410:49:254
11401995100,84cyclictest0-21swapper/611:09:176
11401995100,84cyclictest0-21swapper/611:09:176
11400995090,84cyclictest0-21swapper/511:09:175
11400995090,84cyclictest0-21swapper/511:09:165
113999950537,465cyclictest64450irq/122-eth012:41:084
113999950537,465cyclictest64450irq/122-eth012:41:084
1140299503420,3cyclictest711rcuc/709:17:427
114019950238,256cyclictest27114-21turbostat11:45:006
113959950279,84cyclictest121rcu_preempt11:41:230
1140199501117,296cyclictest0-21swapper/610:48:386
113999949932,464cyclictest0-21swapper/408:12:054
1140299498414,3cyclictest721ktimersoftd/710:49:597
114009949810,237cyclictest0-21swapper/511:19:215
114009949810,237cyclictest0-21swapper/511:19:215
113969949830,126cyclictest0-21swapper/111:54:411
1139699496452,41cyclictest231rcuc/109:17:351
1139699496112,211cyclictest25-21ksoftirqd/110:20:051
1140199492195,84cyclictest9336-1kworker/u17:110:16:526
114009949139,243cyclictest27120-21munin-plugin-st11:45:005
114019948723,212cyclictest0-21swapper/611:32:496
114019948723,212cyclictest0-21swapper/611:32:496
113959948621,177cyclictest0-21swapper/011:53:230
113979948558,211cyclictest0-21swapper/211:55:012
1140199484104,377cyclictest19249-21diskmemload11:19:536
1140199484104,377cyclictest19249-21diskmemload11:19:526
113989948158,211cyclictest704-21nscd11:44:383
113989947995,296cyclictest0-21swapper/311:34:123
113989947995,296cyclictest0-21swapper/311:34:113
113959947915,295cyclictest19249-21diskmemload10:18:190
11395994789,253cyclictest0-21swapper/011:00:150
113989947713,255cyclictest0-21swapper/310:20:063
114029947611,297cyclictest0-21swapper/709:36:187
1140199469129,338cyclictest1944-21kworker/u16:209:29:066
11399994691,465cyclictest0-21swapper/412:15:124
11399994691,465cyclictest0-21swapper/411:20:044
11398994683,213cyclictest0-21swapper/311:19:213
11398994683,213cyclictest0-21swapper/311:19:213
114009946643,85cyclictest0-21swapper/507:15:165
1140299463380,4cyclictest721ktimersoftd/710:01:497
1140299463380,4cyclictest721ktimersoftd/710:01:487
1139899463121,126cyclictest41-21ksoftirqd/311:07:433
1139899463121,126cyclictest41-21ksoftirqd/311:07:423
1139799462379,3cyclictest321ktimersoftd/210:04:262
1139799462379,3cyclictest321ktimersoftd/210:04:252
1139799462120,211cyclictest33-21ksoftirqd/210:19:052
114029946138,256cyclictest698-21ptp4l09:27:257
114019946180,84cyclictest0-21swapper/611:20:236
1140099461249,84cyclictest561ktimersoftd/511:51:145
113999946137,292cyclictest0-21swapper/411:45:044
113979946135,169cyclictest0-21swapper/209:18:252
114029946037,2cyclictest0-21swapper/711:09:337
114029946037,2cyclictest0-21swapper/711:09:337
1139799460119,210cyclictest33-21ksoftirqd/211:43:332
113979945836,256cyclictest0-21swapper/207:15:152
114029945735,2cyclictest0-21swapper/707:15:157
1140199457115,339cyclictest0-21swapper/609:40:146
113989945735,256cyclictest0-21swapper/312:41:013
113989945735,256cyclictest0-21swapper/312:41:013
113989945735,256cyclictest0-21swapper/311:54:593
114029945672,211cyclictest0-21swapper/711:17:437
114029945672,211cyclictest0-21swapper/711:17:437
1140199456116,337cyclictest0-21swapper/610:05:116
114029945532,3cyclictest0-21swapper/710:17:327
1140099455248,118cyclictest30633-21rm10:47:415
1139699455113,169cyclictest0-21swapper/110:47:151
113959945534,255cyclictest0-21swapper/012:42:370
113959945534,255cyclictest0-21swapper/012:42:360
113989945474,84cyclictest20140-21cstates11:20:233
1139799454111,211cyclictest33-21ksoftirqd/212:41:112
1139799454111,211cyclictest33-21ksoftirqd/212:41:102
1139699454371,2cyclictest231rcuc/110:39:101
113979945369,169cyclictest14396-21munin-node09:40:162
113969945326,211cyclictest25-21ksoftirqd/111:45:011
1139699453110,340cyclictest0-21swapper/110:01:231
1139699453110,340cyclictest0-21swapper/110:01:231
1140199452111,338cyclictest0-21swapper/611:55:006
1139599451110,338cyclictest0-21swapper/012:14:120
1140199450110,338cyclictest0-21swapper/609:16:026
113969945028,257cyclictest19249-21diskmemload10:40:041
114029944724,4cyclictest20821-21diskmemload11:00:177
113999944621,422cyclictest0-21swapper/408:55:164
114029944523,256cyclictest0-21swapper/711:53:047
114019944564,84cyclictest0-21swapper/610:39:196
114009944415,253cyclictest0-21swapper/510:16:455
1139699444230,84cyclictest0-21swapper/112:14:121
1139699444103,338cyclictest0-21swapper/112:15:091
113959944422,259cyclictest0-21swapper/010:04:540
113959944422,259cyclictest0-21swapper/010:04:530
113959944420,85cyclictest0-21swapper/009:37:480
113979944316,211cyclictest19483-21apt-get11:20:112
113969944262,257cyclictest11393-21cyclictest11:16:161
113969944262,257cyclictest11393-21cyclictest11:16:151
113969944220,256cyclictest0-21swapper/111:10:031
113969944220,256cyclictest0-21swapper/111:10:031
113959944219,126cyclictest0-21swapper/009:17:340
113979944017,3cyclictest0-21swapper/208:12:022
113979944012,127cyclictest0-21swapper/210:05:102
113959944015,261cyclictest0-21swapper/010:40:000
114009943755,169cyclictest0-21swapper/509:18:165
1140099437354,80cyclictest551rcuc/512:14:475
1139899436182,126cyclictest121rcu_preempt09:36:373
114029943513,2cyclictest0-21swapper/711:45:027
114009943514,2cyclictest0-21swapper/512:42:375
114009943514,2cyclictest0-21swapper/512:42:375
113989943596,84cyclictest785-21sh09:16:053
11402994348,423cyclictest0-21swapper/712:41:177
11402994348,423cyclictest0-21swapper/712:41:167
1140299432136,212cyclictest721ktimersoftd/708:11:567
114019943146,168cyclictest0-21swapper/608:55:176
114019943050,85cyclictest0-21swapper/609:37:116
11398994307,256cyclictest0-21swapper/310:04:363
11398994307,256cyclictest0-21swapper/310:04:353
114009942747,84cyclictest0-21swapper/509:37:115
114009942745,84cyclictest0-21swapper/509:40:365
113979942646,48cyclictest14932-21sh10:39:132
11402994241,257cyclictest0-21swapper/712:12:467
11395994240,126cyclictest19925-21ssh11:20:160
11397994231,256cyclictest0-21swapper/210:40:042
113979942281,338cyclictest0-21swapper/211:00:202
113969942137,168cyclictest25-21ksoftirqd/111:20:211
114019942081,337cyclictest0-21swapper/611:10:106
113969941980,84cyclictest0-21swapper/111:10:101
113989941879,84cyclictest0-21swapper/309:40:133
1140199417119,295cyclictest16448-21cat07:15:176
113999941738,298cyclictest0-21swapper/410:40:044
113999941738,295cyclictest0-21swapper/411:00:154
113969941677,84cyclictest0-21swapper/112:41:221
113969941677,84cyclictest0-21swapper/112:41:211
113959941576,84cyclictest0-21swapper/009:40:230
113989941475,84cyclictest0-21swapper/311:00:203
113989941475,84cyclictest0-21swapper/310:39:103
113969941475,84cyclictest7101-21gltestperf09:40:281
113969941475,84cyclictest0-21swapper/111:45:051
114009941273,84cyclictest0-21swapper/511:20:095
113969941273,84cyclictest0-21swapper/111:00:201
114009940972,127cyclictest0-21swapper/510:05:115
113999940825,380cyclictest0-21swapper/411:10:124
113969940768,84cyclictest0-21swapper/107:15:171
114029940664,339cyclictest0-21swapper/709:40:287
1140099406111,211cyclictest0-21swapper/510:39:305
113989940667,84cyclictest0-21swapper/307:15:173
113989940566,84cyclictest0-21swapper/310:05:103
113989940566,84cyclictest0-21swapper/309:25:583
114019940422,84cyclictest0-21swapper/612:41:176
114019940422,84cyclictest0-21swapper/612:41:176
113999940263,337cyclictest0-21swapper/407:15:144
114029940020,169cyclictest73-21ksoftirqd/711:20:237
113999940061,84cyclictest0-21swapper/410:05:114
114019939962,84cyclictest0-21swapper/612:15:106
114019939960,84cyclictest0-21swapper/608:12:016
1140099398141,127cyclictest121rcu_preempt11:35:095
114029939655,338cyclictest0-21swapper/712:15:097
113999939656,338cyclictest0-21swapper/411:35:084
113959939515,216cyclictest0-21swapper/011:10:120
114009939455,84cyclictest0-21swapper/511:10:105
114009939455,84cyclictest0-21swapper/511:00:205
113959939354,84cyclictest7889-21kworker/u16:312:15:090
113989938994,84cyclictest0-21swapper/312:15:103
11400993866,92cyclictest0-21swapper/508:55:175
114019938284,170cyclictest20767-21wc11:00:156
114029937946,78cyclictest0-21swapper/711:10:117
114029937941,3cyclictest0-21swapper/708:55:207
114029937841,171cyclictest0-21swapper/710:40:047
1139799378125,169cyclictest23795-21kworker/u16:211:10:122
113979937575,169cyclictest33-21ksoftirqd/212:15:112
113989936830,84cyclictest0-21swapper/311:10:103
1139599368153,211cyclictest0-21swapper/008:55:160
113979936221,83cyclictest0-21swapper/208:55:162
1139599362106,253cyclictest0-21swapper/010:05:100
113989936016,253cyclictest18303-21taskset08:11:533
1139899359105,251cyclictest0-21swapper/308:55:183
113969935625,248cyclictest0-21swapper/111:35:031
113979935314,84cyclictest0-21swapper/211:35:082
113959934849,168cyclictest9-21ksoftirqd/007:15:170
11395993454,211cyclictest9-21ksoftirqd/011:45:050
114029934491,84cyclictest121rcu_preempt10:05:107
113969934184,254cyclictest18817-21ssh10:05:111
114019934084,254cyclictest0-21swapper/611:45:036
114029933881,254cyclictest0-21swapper/711:45:037
113969933883,253cyclictest0-21swapper/108:12:011
113969933742,76cyclictest0-21swapper/108:55:161
11400993366,246cyclictest0-21swapper/510:40:035
114029933439,43cyclictest0-21swapper/711:35:087
114009933137,84cyclictest0-21swapper/508:11:545
1139599327283,42cyclictest101ktimersoftd/011:35:040
114009932367,253cyclictest0-21swapper/511:45:055
114009932270,84cyclictest0-21swapper/512:15:105
113979931924,85cyclictest0-21swapper/211:45:052
1139899316106,86cyclictest15614-21apt-get10:40:043
114019931360,171cyclictest0-21swapper/610:40:036
113959930712,211cyclictest0-21swapper/010:40:040
113989930548,254cyclictest11393-21cyclictest11:45:033
11398992961,50cyclictest0-21swapper/311:35:083
114019929037,3cyclictest0-21swapper/611:35:046
9889210095,2sleep10-21swapper/107:05:181
1084429148,27sleep20-21swapper/207:08:172
1071428845,39sleep40-21swapper/407:06:274
1069828555,27sleep60-21swapper/607:06:136
1074528252,27sleep50-21swapper/507:06:525
1070128152,26sleep00-21swapper/007:06:140
1086928048,28sleep70-21swapper/707:08:377
1068627950,26sleep30-21swapper/307:06:023
8222720,0sleep20-21swapper/210:12:142
287742700,0sleep60-21swapper/612:03:556
1140099624,43cyclictest0-21swapper/510:20:175
1139999622,38cyclictest4020-21sh10:51:424
1140099598,38cyclictest7739-21ssh09:20:485
1140099594,45cyclictest0-21swapper/512:06:125
1139999592,29cyclictest0-21swapper/409:55:134
1139699575,17cyclictest3661-21perl09:55:161
1140099566,41cyclictest4198-21ssh12:26:075
1139999562,40cyclictest0-21swapper/411:56:064
11395995612,29cyclictest0-21swapper/009:21:010
1140099553,41cyclictest0-21swapper/511:56:045
11401995429,14cyclictest65-21ksoftirqd/609:55:166
1140099537,32cyclictest5356-21ssh10:33:265
11400995317,27cyclictest57-21ksoftirqd/512:35:305
1140099526,34cyclictest5989-21ssh09:56:115
1140099524,34cyclictest25127-21ssh09:31:085
1140099524,34cyclictest25127-21ssh09:31:075
1140099521,41cyclictest0-21swapper/510:52:045
1139999521,46cyclictest21730-21rt-features12:35:264
1139999512,32cyclictest0-21swapper/409:20:144
1139999503,28cyclictest21194-21taskset08:15:424
1139999501,28cyclictest5533-21ssh10:33:354
1139599505,29cyclictest9-21ksoftirqd/010:20:350
1140099490,35cyclictest0-21swapper/512:04:595
1140099485,30cyclictest20020-21sort08:15:195
1139999481,43cyclictest0-21swapper/409:30:234
1139999481,43cyclictest0-21swapper/409:30:234
1139599481,44cyclictest0-21swapper/009:55:110
11395994810,24cyclictest0-21swapper/012:25:320
1139999462,27cyclictest0-21swapper/410:21:284
1139999461,41cyclictest2669-21ntp_states12:25:224
11395994611,27cyclictest9-21ksoftirqd/010:51:090
1139999452,31cyclictest30287-21cron12:05:004
1140099443,27cyclictest15214-21chrt08:08:185
1139999441,34cyclictest324-21processes12:05:264
1139899448,32cyclictest3634-21cut09:55:163
1139599445,25cyclictest9-21ksoftirqd/009:32:030
1139599445,25cyclictest9-21ksoftirqd/009:32:030
1140199436,27cyclictest65-21ksoftirqd/609:20:176
1139899438,24cyclictest41-21ksoftirqd/310:20:353
1139599430,31cyclictest17377-21ssh11:57:560
11396994210,21cyclictest25-21ksoftirqd/111:55:201
1139599426,25cyclictest0-21swapper/008:08:020
1139599423,28cyclictest9-21ksoftirqd/012:37:370
11395994211,20cyclictest9-21ksoftirqd/012:07:150
1139699418,18cyclictest25-21ksoftirqd/109:31:211
1139699418,18cyclictest25-21ksoftirqd/109:31:201
1139699414,25cyclictest0-21swapper/112:06:181
1139599418,16cyclictest0-21swapper/012:05:000
1139899406,25cyclictest41-21ksoftirqd/312:27:173
1139899405,24cyclictest41-21ksoftirqd/310:50:193
1139699406,17cyclictest25-21ksoftirqd/110:50:171
1140199392,5cyclictest0-21swapper/609:30:196
1140199392,5cyclictest0-21swapper/609:30:196
1139899397,22cyclictest41-21ksoftirqd/312:35:153
11398993930,5cyclictest0-21swapper/309:30:143
11398993930,5cyclictest0-21swapper/309:30:143
1139699394,22cyclictest25-21ksoftirqd/112:26:161
1139699393,20cyclictest25-21ksoftirqd/110:34:071
11396993910,19cyclictest25-21ksoftirqd/110:21:131
11396993910,17cyclictest121rcu_preempt12:35:201
11395993911,18cyclictest9-21ksoftirqd/008:17:010
1140299388,4cyclictest721ktimersoftd/709:30:187
1140299388,4cyclictest721ktimersoftd/709:30:177
1140299382,32cyclictest0-21swapper/709:55:137
1140199381,5cyclictest2050-21gltestperf12:25:146
1139899386,21cyclictest41-21ksoftirqd/309:21:323
1139699385,22cyclictest25-21ksoftirqd/109:21:011
1140299372,31cyclictest0-21swapper/712:25:167
1140199379,16cyclictest13089-21ssh11:55:186
11401993712,15cyclictest65-21ksoftirqd/612:05:186
11401993712,15cyclictest65-21ksoftirqd/610:20:216
1139999371,31cyclictest15199-21seq08:08:054
1139899376,21cyclictest41-21ksoftirqd/311:55:193
11395993715,6cyclictest4987-21rm10:33:050
1140299362,4cyclictest0-21swapper/709:20:067
1140199368,18cyclictest65-21ksoftirqd/612:36:516
1139899367,19cyclictest41-21ksoftirqd/312:06:233
11398993612,14cyclictest0-21swapper/310:34:153
1139799362,3cyclictest0-21swapper/210:20:172
1139799362,31cyclictest23213-21irqstats09:30:202
1139799362,31cyclictest23213-21irqstats09:30:202
1139699366,19cyclictest25-21ksoftirqd/108:15:131
1140299351,3cyclictest12230-21cpu10:20:177
1140199353,24cyclictest65-21ksoftirqd/610:50:146
1140199352,25cyclictest65-21ksoftirqd/608:15:146
11397993529,3cyclictest3402-21fschecks_count09:55:152
1139799351,5cyclictest32449-21ssh10:50:032
1139699356,20cyclictest25-21ksoftirqd/112:04:551
1139899348,15cyclictest41-21ksoftirqd/308:15:223
1139899346,7cyclictest30303-21turbostat.cron12:05:003
1139799341,30cyclictest0-21swapper/209:20:082
1140199334,18cyclictest65-21ksoftirqd/610:33:286
1139799331,29cyclictest0-21swapper/212:25:192
1139799331,28cyclictest14699-21grep11:55:322
11396993310,16cyclictest25-21ksoftirqd/108:08:261
1140299321,29cyclictest0-21swapper/710:50:027
1140299321,29cyclictest0-21swapper/708:15:027
11397993225,4cyclictest30498-21date12:05:012
1139799321,29cyclictest0-21swapper/208:15:022
11402993124,4cyclictest22613-21ssh12:35:447
11402993124,4cyclictest14918-21sshd11:55:377
1140199312,19cyclictest65-21ksoftirqd/608:08:476
11397993124,4cyclictest2727-21ssh12:07:042
11397993023,4cyclictest4569-21ssh10:32:422
11397993022,5cyclictest20827-21tune2fs12:35:162
11402992923,4cyclictest1609-21ssh12:06:027
11402992922,5cyclictest5636-21ssh10:33:407
11399992825,3cyclictest0-21swapper/407:12:284
11398992810,18cyclictest0-21swapper/307:12:333
11396992810,18cyclictest0-21swapper/107:12:241
11402992710,17cyclictest0-21swapper/707:12:307
11401992727,0cyclictest0-21swapper/607:12:436
11397992710,17cyclictest0-21swapper/207:12:222
11395992710,17cyclictest0-21swapper/007:12:280
11398992618,4cyclictest401ktimersoftd/308:08:453
11400992525,0cyclictest0-21swapper/507:12:275
11402992417,4cyclictest152842sleep708:09:177
11402992115,4cyclictest30365-21cut12:05:017
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional