You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-10 - 21:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot4s.osadl.org (updated Sat Jan 10, 2026 12:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
5827872241175,52sleep50-21swapper/507:09:545
5827562238175,21sleep10-21swapper/107:09:271
5826102230170,19sleep40-21swapper/407:07:204
5799552228190,24sleep20-21swapper/207:05:022
5803582226170,18sleep30-21swapper/307:05:113
5825202216183,21sleep60-21swapper/607:06:026
5827142213174,24sleep70-21swapper/707:08:527
5825592210180,19sleep00-21swapper/007:06:360
6090132530,0sleep60-21swapper/607:50:216
583030992721,5cyclictest698775-21cron10:30:005
58303099260,21cyclictest0-21swapper/508:54:595
583030992518,3cyclictest0-21swapper/511:00:005
583020992521,3cyclictest750453-21cron12:00:013
58301599250,24cyclictest0-21swapper/112:05:001
58303699240,23cyclictest0-21swapper/710:10:127
58303699240,11cyclictest0-21swapper/709:44:227
58303299240,24cyclictest770467-21sh12:35:016
58303099240,23cyclictest0-21swapper/507:55:105
58303099240,0cyclictest0-21swapper/509:20:105
58302699240,23cyclictest681658-21sendmail10:00:004
58302699240,0cyclictest0-21swapper/411:40:124
58302099240,24cyclictest0-21swapper/311:15:053
58302099240,23cyclictest670222-21sendmail09:40:003
58302099240,23cyclictest615396-21munin-run08:04:593
58302099240,23cyclictest0-21swapper/311:35:013
583015992422,1cyclictest664-21in:imuxsock08:20:001
583015992421,2cyclictest764776-21munin-run12:25:011
58303699231,4cyclictest0-21swapper/710:28:177
58303699230,23cyclictest0-21swapper/708:19:597
58303699230,1cyclictest0-21swapper/709:20:007
583032992320,3cyclictest713348-21awk10:54:596
58303299230,22cyclictest0-21swapper/609:15:046
583030992321,2cyclictest0-21swapper/509:35:115
583030992319,3cyclictest725185-21apt-get11:15:125
58303099230,1cyclictest719482-21apt-get11:05:125
58303099230,18cyclictest655940-21fwupd09:15:035
58302699230,1cyclictest773380-21http12:40:014
58302699230,1cyclictest716227-21sendmail-msp11:00:004
583020992321,1cyclictest765196-21apt-get12:25:143
58302099230,2cyclictest597966-21munin-run07:35:013
58302099230,22cyclictest0-21swapper/311:10:123
58302099230,21cyclictest687787-21apt-get10:10:123
58302099230,1cyclictest618408-21readlink08:09:593
583016992321,1cyclictest750484-21perf12:00:002
58301699230,22cyclictest0-21swapper/209:30:132
58301699230,22cyclictest0-21swapper/209:20:102
58301699230,22cyclictest0-21swapper/208:50:112
58301699230,22cyclictest0-21swapper/208:35:112
58301699230,1cyclictest664-21in:imuxsock12:20:012
583015992321,1cyclictest684526-21perf10:04:591
58301599230,22cyclictest753766-21apt-get12:05:111
58301599230,22cyclictest0-21swapper/111:00:011
58301599230,22cyclictest0-21swapper/110:10:001
583011992323,0cyclictest0-21swapper/011:40:120
58301199230,22cyclictest0-21swapper/012:35:120
58301199230,22cyclictest0-21swapper/009:45:120
583036992221,1cyclictest0-21swapper/710:40:007
583036992221,1cyclictest0-21swapper/707:49:597
583036992220,1cyclictest0-21swapper/711:30:017
58303699220,21cyclictest745190-21apt-get11:50:117
58303699220,21cyclictest0-21swapper/708:50:117
58303699220,0cyclictest0-21swapper/707:55:117
583032992222,0cyclictest0-21swapper/610:55:126
583032992220,2cyclictest721914-21munin-run11:10:016
583032992220,1cyclictest610091-21apt-get07:55:116
58303299220,22cyclictest0-21swapper/609:25:136
58303299220,21cyclictest0-21swapper/612:25:146
58303299220,21cyclictest0-21swapper/611:20:116
58303299220,21cyclictest0-21swapper/608:20:116
583030992221,1cyclictest770503-21idleruntime-cro12:35:015
583030992220,1cyclictest753766-21apt-get12:05:115
583030992220,1cyclictest598385-21apt-get07:35:125
58303099220,4cyclictest638909-21cat08:45:005
58303099220,22cyclictest629952-21idleruntime-cro08:30:005
58303099220,22cyclictest0-21swapper/512:20:015
58303099220,21cyclictest0-21swapper/510:45:115
58303099220,21cyclictest0-21swapper/510:45:115
58303099220,21cyclictest0-21swapper/510:20:115
58303099220,21cyclictest0-21swapper/507:45:125
58303099220,21cyclictest0-21swapper/507:15:135
58303099220,1cyclictest621777-21apt-get08:15:115
58303099220,1cyclictest0-21swapper/510:45:005
58303099220,1cyclictest0-21swapper/510:44:595
58303099220,1cyclictest0-21swapper/508:00:135
583026992221,1cyclictest0-21swapper/409:40:104
583026992220,1cyclictest721919-21perf11:10:014
583026992220,1cyclictest615375-21cron08:04:594
583026992220,1cyclictest600841-21munin-run07:40:004
583026992220,1cyclictest0-21swapper/407:25:124
583026992219,2cyclictest747612-21idleruntime-cro11:55:014
58302699220,21cyclictest653466-21apt-get09:10:124
58302699220,21cyclictest0-21swapper/411:15:014
58302699220,21cyclictest0-21swapper/407:55:104
58302099220,21cyclictest0-21swapper/310:55:123
58302099220,21cyclictest0-21swapper/308:10:113
58302099220,1cyclictest0-21swapper/310:35:133
583016992220,1cyclictest707633-21munin-run10:45:002
583016992220,1cyclictest707633-21munin-run10:45:002
583016992218,3cyclictest673082-21sh09:45:002
58301699220,21cyclictest708052-21apt-get10:45:122
58301699220,21cyclictest708052-21apt-get10:45:112
58301699220,21cyclictest610091-21apt-get07:55:112
58301699220,21cyclictest0-21swapper/211:50:122
58301699220,21cyclictest0-21swapper/210:55:122
58301699220,21cyclictest0-21swapper/210:35:132
58301699220,21cyclictest0-21swapper/210:05:112
58301699220,21cyclictest0-21swapper/208:40:152
58301599220,21cyclictest0-21swapper/111:05:121
58301599220,21cyclictest0-21swapper/110:20:101
58301599220,21cyclictest0-21swapper/108:50:111
58301599220,21cyclictest0-21swapper/108:10:001
583011992220,1cyclictest0-21swapper/010:15:110
58301199220,21cyclictest0-21swapper/011:35:100
58301199220,21cyclictest0-21swapper/008:35:010
58301199220,21cyclictest0-21swapper/007:45:110
58301199220,1cyclictest615404-21awk08:05:000
583036992121,0cyclictest0-21swapper/710:55:127
583036992121,0cyclictest0-21swapper/709:00:127
583036992121,0cyclictest0-21swapper/707:30:137
583036992119,2cyclictest601277-21apt-get07:40:117
583036992119,1cyclictest0-21swapper/710:20:197
58303699210,20cyclictest0-21swapper/712:00:117
58303699210,20cyclictest0-21swapper/710:50:127
58303699210,20cyclictest0-21swapper/709:25:127
58303699210,0cyclictest0-21swapper/712:30:137
58303699210,0cyclictest0-21swapper/711:20:117
583032992121,0cyclictest0-21swapper/611:55:126
583032992121,0cyclictest0-21swapper/609:45:126
583032992121,0cyclictest0-21swapper/609:40:096
583032992120,1cyclictest633469-21apt-get08:35:126
583032992120,1cyclictest0-21swapper/609:15:006
58303299210,21cyclictest773339-21perf12:40:006
58303299210,21cyclictest624221-21idleruntime-cro08:19:596
58303299210,0cyclictest0-21swapper/607:50:006
583030992121,0cyclictest0-21swapper/508:45:115
583030992120,1cyclictest583334-21apt-get07:10:125
583030992118,3cyclictest0-21swapper/512:25:135
58303099210,21cyclictest736202-21perf11:35:015
58303099210,20cyclictest0-21swapper/512:35:145
58303099210,1cyclictest592266-21awk07:25:015
58303099210,0cyclictest0-21swapper/508:20:115
583026992121,0cyclictest0-21swapper/408:50:004
583026992120,1cyclictest0-21swapper/411:35:114
583026992120,1cyclictest0-21swapper/410:40:134
583026992120,1cyclictest0-21swapper/410:40:124
583026992120,1cyclictest0-21swapper/408:40:154
583026992120,1cyclictest0-21swapper/408:20:124
583026992120,1cyclictest0-21swapper/408:15:124
583026992120,0cyclictest0-21swapper/411:25:094
583026992119,1cyclictest0-21swapper/411:30:124
583026992119,1cyclictest0-21swapper/409:50:104
583026992119,1cyclictest0-21swapper/407:15:004
58302699210,20cyclictest0-21swapper/407:15:124
58302699210,0cyclictest0-21swapper/409:05:134
583020992121,0cyclictest0-21swapper/309:10:123
583020992121,0cyclictest0-21swapper/308:20:123
583020992120,1cyclictest753370-21idleruntime-cro12:05:013
583020992120,1cyclictest728057-21apt-get11:20:113
583020992120,1cyclictest0-21swapper/309:15:133
583020992119,1cyclictest761902-21turbostat12:20:003
58302099210,20cyclictest0-21swapper/307:25:123
58302099210,20cyclictest0-21swapper/307:15:123
58302099210,0cyclictest0-21swapper/309:30:133
583016992121,0cyclictest0-21swapper/207:15:122
583016992119,1cyclictest682092-21apt-get10:00:152
583016992119,1cyclictest678798-21munin-run09:55:002
58301699210,21cyclictest606548-21apt-get07:50:002
58301699210,21cyclictest0-21swapper/212:30:202
58301699210,20cyclictest0-21swapper/209:10:112
58301699210,0cyclictest0-21swapper/212:10:122
583015992121,0cyclictest0-21swapper/109:35:101
583015992120,1cyclictest0-21swapper/108:00:131
583015992120,1cyclictest0-21swapper/107:49:591
583015992120,0cyclictest0-21swapper/110:25:091
583015992120,0cyclictest0-21swapper/107:25:121
583015992119,1cyclictest0-21swapper/108:30:141
58301599210,21cyclictest0-21swapper/107:15:121
583011992121,0cyclictest0-21swapper/009:15:040
583011992121,0cyclictest0-21swapper/007:10:120
583011992120,1cyclictest0-21swapper/011:15:130
583011992120,1cyclictest0-21swapper/009:10:120
58301199210,1cyclictest0-21swapper/010:25:000
58301199210,0cyclictest0-21swapper/011:50:120
58301199210,0cyclictest0-21swapper/010:40:130
58301199210,0cyclictest0-21swapper/010:40:130
58301199210,0cyclictest0-21swapper/009:25:130
583036992020,0cyclictest0-21swapper/710:40:137
583036992020,0cyclictest0-21swapper/710:40:137
583036992020,0cyclictest0-21swapper/709:20:107
583036992020,0cyclictest0-21swapper/709:10:127
583036992020,0cyclictest0-21swapper/707:20:117
583036992019,1cyclictest773399-21dpkg12:40:007
58303699200,19cyclictest0-21swapper/708:20:127
58303699200,0cyclictest0-21swapper/708:10:007
58303699200,0cyclictest0-21swapper/707:50:127
583032992020,0cyclictest0-21swapper/612:15:126
583032992020,0cyclictest0-21swapper/611:50:126
583032992020,0cyclictest0-21swapper/610:45:126
583032992020,0cyclictest0-21swapper/610:45:116
583032992020,0cyclictest0-21swapper/610:20:196
583032992020,0cyclictest0-21swapper/609:30:136
583032992020,0cyclictest0-21swapper/607:15:136
583030992020,0cyclictest0-21swapper/509:30:125
583030992019,1cyclictest0-21swapper/512:20:115
583030992018,1cyclictest644892-21apt-get08:55:115
583030992017,3cyclictest0-21swapper/508:10:005
58303099200,20cyclictest0-21swapper/511:25:095
58303099200,0cyclictest0-21swapper/509:00:135
583026992020,0cyclictest0-21swapper/411:15:134
583026992019,1cyclictest0-21swapper/410:45:124
583026992019,1cyclictest0-21swapper/410:45:124
583026992019,1cyclictest0-21swapper/408:30:134
583026992019,1cyclictest0-21swapper/407:45:124
583020992020,0cyclictest0-21swapper/310:25:103
583020992020,0cyclictest0-21swapper/309:50:113
583020992020,0cyclictest0-21swapper/309:05:133
583020992020,0cyclictest0-21swapper/308:40:143
583020992020,0cyclictest0-21swapper/307:20:123
583020992018,1cyclictest745190-21apt-get11:50:113
583020992018,1cyclictest699217-21apt-get10:30:133
583016992020,0cyclictest0-21swapper/209:15:132
583016992020,0cyclictest0-21swapper/208:25:122
583016992020,0cyclictest0-21swapper/208:05:102
583016992019,1cyclictest0-21swapper/212:35:132
583016992019,1cyclictest0-21swapper/211:15:052
58301699200,0cyclictest0-21swapper/209:45:122
583015992020,0cyclictest0-21swapper/112:35:131
583015992020,0cyclictest0-21swapper/111:25:011
583015992020,0cyclictest0-21swapper/110:45:121
583015992020,0cyclictest0-21swapper/110:45:111
583015992020,0cyclictest0-21swapper/110:35:131
583015992020,0cyclictest0-21swapper/108:35:011
583015992020,0cyclictest0-21swapper/107:30:131
583015992019,1cyclictest0-21swapper/110:50:121
583015992019,1cyclictest0-21swapper/109:29:591
583015992019,1cyclictest0-21swapper/107:35:121
583015992018,1cyclictest646117-21ntpq08:55:161
583015992018,1cyclictest363-21systemd-journal12:00:011
58301599200,0cyclictest0-21swapper/111:15:131
583011992020,0cyclictest0-21swapper/012:05:100
583011992020,0cyclictest0-21swapper/007:40:110
583011992019,1cyclictest733338-21turbostat11:30:010
583011992019,1cyclictest681627-21cron10:00:000
583011992019,1cyclictest0-21swapper/010:50:000
583011992019,1cyclictest0-21swapper/010:49:590
583011992019,1cyclictest0-21swapper/009:05:120
583011992018,2cyclictest647325-21sendmail09:00:000
58301199200,20cyclictest0-21swapper/012:00:100
58301199200,0cyclictest0-21swapper/009:00:130
583036991919,0cyclictest0-21swapper/707:15:137
583032991919,0cyclictest659233-21apt-get09:20:096
583032991919,0cyclictest0-21swapper/612:10:116
583032991919,0cyclictest0-21swapper/610:15:116
583032991919,0cyclictest0-21swapper/609:35:106
583032991919,0cyclictest0-21swapper/608:10:116
583032991919,0cyclictest0-21swapper/608:05:116
583032991919,0cyclictest0-21swapper/607:35:126
583032991918,1cyclictest704491-21apt-get10:40:026
583032991918,1cyclictest704491-21apt-get10:40:026
583032991918,1cyclictest704491-21apt-get10:40:006
583032991918,1cyclictest647366-21sendmail-msp09:00:006
583032991918,1cyclictest0-21swapper/611:40:016
58303299190,19cyclictest0-21swapper/611:30:016
583030991919,0cyclictest0-21swapper/511:55:115
583030991919,0cyclictest0-21swapper/510:05:115
583030991918,1cyclictest756616-21apt-get12:10:115
583030991918,1cyclictest0-21swapper/509:55:115
583030991918,1cyclictest0-21swapper/509:40:105
583030991917,2cyclictest0-21swapper/511:50:005
583030991917,2cyclictest0-21swapper/510:14:595
583026991919,0cyclictest0-21swapper/411:50:004
583026991919,0cyclictest0-21swapper/410:10:124
583026991919,0cyclictest0-21swapper/408:35:124
583020991919,0cyclictest0-21swapper/312:20:103
583020991919,0cyclictest0-21swapper/311:25:083
583020991919,0cyclictest0-21swapper/308:35:003
583020991917,1cyclictest632778-21apt-get08:34:593
583016991919,0cyclictest0-21swapper/211:00:122
583016991919,0cyclictest0-21swapper/209:55:102
583016991919,0cyclictest0-21swapper/207:50:012
583016991919,0cyclictest0-21swapper/207:25:132
583016991919,0cyclictest0-21swapper/207:20:122
583016991918,1cyclictest0-21swapper/209:25:122
583015991919,0cyclictest0-21swapper/111:30:121
583015991919,0cyclictest0-21swapper/111:25:091
583015991919,0cyclictest0-21swapper/109:40:111
583015991919,0cyclictest0-21swapper/109:25:001
583015991919,0cyclictest0-21swapper/109:10:461
583015991918,1cyclictest676365-21apt-get09:50:121
583015991918,0cyclictest0-21swapper/109:55:111
583011991919,0cyclictest0-21swapper/011:30:120
583011991919,0cyclictest0-21swapper/011:15:000
583011991919,0cyclictest0-21swapper/007:35:120
583011991919,0cyclictest0-21swapper/007:25:110
583011991917,1cyclictest0-21swapper/011:10:010
583036991818,0cyclictest0-21swapper/711:05:127
583036991818,0cyclictest0-21swapper/711:00:137
583036991818,0cyclictest0-21swapper/710:05:107
58303699180,18cyclictest0-21swapper/709:05:127
58303699180,17cyclictest0-21swapper/708:35:127
58303699180,0cyclictest0-21swapper/711:56:107
583032991818,0cyclictest0-21swapper/612:05:106
583032991818,0cyclictest0-21swapper/611:15:126
583032991818,0cyclictest0-21swapper/608:40:146
583032991818,0cyclictest0-21swapper/607:40:116
583030991818,0cyclictest0-21swapper/510:30:225
583030991818,0cyclictest0-21swapper/508:30:145
583026991818,0cyclictest0-21swapper/407:40:114
583026991817,1cyclictest673514-21apt-get09:45:114
583026991817,1cyclictest0-21swapper/410:30:134
583026991817,1cyclictest0-21swapper/407:50:124
58302699180,14cyclictest0-21swapper/410:15:154
583020991818,0cyclictest0-21swapper/310:50:123
583020991818,0cyclictest0-21swapper/309:20:083
583020991818,0cyclictest0-21swapper/308:30:003
583020991818,0cyclictest0-21swapper/307:10:113
583020991817,1cyclictest0-21swapper/312:30:203
583020991816,1cyclictest670661-21apt-get09:40:103
583016991818,0cyclictest0-21swapper/210:10:122
583016991817,1cyclictest0-21swapper/208:10:012
583015991818,0cyclictest0-21swapper/107:40:111
58301599180,18cyclictest0-21swapper/107:50:171
583011991818,0cyclictest0-21swapper/011:20:110
583011991818,0cyclictest0-21swapper/008:45:120
583011991818,0cyclictest0-21swapper/008:05:110
583011991818,0cyclictest0-21swapper/007:55:110
583011991818,0cyclictest0-21swapper/007:15:120
583011991817,1cyclictest0-21swapper/010:05:100
583036991717,0cyclictest0-21swapper/710:15:117
583036991717,0cyclictest0-21swapper/708:05:117
583036991717,0cyclictest0-21swapper/707:40:017
583036991716,1cyclictest0-21swapper/708:35:007
583036991714,2cyclictest766500-21ntpq12:25:207
58303699170,1cyclictest0-21swapper/708:25:127
583032991717,0cyclictest0-21swapper/611:10:126
583032991716,1cyclictest750912-21apt-get12:00:106
583030991717,0cyclictest0-21swapper/511:00:125
583030991717,0cyclictest0-21swapper/509:50:125
583030991717,0cyclictest0-21swapper/508:35:125
583030991717,0cyclictest0-21swapper/507:50:125
583030991716,1cyclictest0-21swapper/511:10:125
583030991715,2cyclictest0-21swapper/510:15:115
583026991716,1cyclictest0-21swapper/409:25:134
583026991716,1cyclictest0-21swapper/409:15:124
583026991716,0cyclictest0-21swapper/412:00:104
583026991715,1cyclictest0-21swapper/412:20:114
58302699170,16cyclictest670212-21latency_hist09:40:014
583020991717,0cyclictest0-21swapper/312:10:123
583020991717,0cyclictest0-21swapper/310:45:123
583020991717,0cyclictest0-21swapper/310:45:123
583020991717,0cyclictest0-21swapper/310:05:113
583020991717,0cyclictest0-21swapper/308:50:113
583020991717,0cyclictest0-21swapper/307:55:113
58302099170,16cyclictest0-21swapper/311:50:013
58302099170,14cyclictest0-21swapper/309:45:073
583016991717,0cyclictest0-21swapper/212:20:102
583016991717,0cyclictest0-21swapper/209:00:112
583016991716,1cyclictest650618-21apt-get09:05:122
583016991716,1cyclictest646-21dbus-daemon08:20:002
583016991716,1cyclictest0-21swapper/211:30:132
583016991716,1cyclictest0-21swapper/210:20:112
583016991716,1cyclictest0-21swapper/208:00:132
583016991714,2cyclictest0-21swapper/210:20:012
58301599170,16cyclictest0-21swapper/108:25:121
583011991717,0cyclictest0-21swapper/009:40:100
583011991717,0cyclictest0-21swapper/008:20:120
583011991717,0cyclictest0-21swapper/008:15:110
583011991716,1cyclictest0-21swapper/011:50:010
583011991716,1cyclictest0-21swapper/008:30:140
583011991715,1cyclictest0-21swapper/008:40:140
583036991616,0cyclictest0-21swapper/712:10:117
583036991615,1cyclictest679213-21apt-get09:55:107
583036991615,1cyclictest674757-21ntp_kernel_pll_09:45:187
583036991612,3cyclictest684510-21idleruntime-cro10:04:597
583032991616,0cyclictest0-21swapper/612:20:116
583032991616,0cyclictest0-21swapper/611:40:116
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional