You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-16 - 18:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot4s.osadl.org (updated Tue Jun 16, 2026 12:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1343852259174,25sleep70-21swapper/707:06:537
1343492250178,22sleep00-21swapper/007:06:220
1343102243170,22sleep60-21swapper/607:05:486
1343812228190,25sleep30-21swapper/307:06:493
1343092228191,25sleep50-21swapper/507:05:475
1345652224186,25sleep10-21swapper/107:09:211
1343262224185,24sleep40-21swapper/407:06:034
1344622209173,25sleep20-21swapper/207:07:532
134828996434,17cyclictest0-21swapper/510:19:515
13482899319,4cyclictest0-21swapper/510:41:505
13482899269,4cyclictest0-21swapper/511:14:465
13482899269,4cyclictest0-21swapper/509:57:535
13482899269,4cyclictest0-21swapper/509:57:535
13482899269,4cyclictest0-21swapper/509:02:585
13482899269,4cyclictest0-21swapper/508:41:005
13482899260,25cyclictest215135-21run-parts09:22:165
134825992622,3cyclictest237126-21cron10:00:004
134825992622,3cyclictest237126-21cron10:00:004
134821992625,1cyclictest0-21swapper/210:25:012
134833992523,1cyclictest287667-21apt-get11:25:117
13483099250,24cyclictest203546-21awk09:05:016
13482899258,4cyclictest0-21swapper/510:30:505
13482899258,4cyclictest0-21swapper/509:46:545
13482899258,4cyclictest0-21swapper/507:46:065
13482899250,1cyclictest286062-21ntpq11:20:215
13482899250,1cyclictest185821-21sqv08:35:015
13482599250,24cyclictest310921-21awk12:04:594
13482299250,24cyclictest0-21swapper/309:20:013
134821992523,2cyclictest3422186-21systemd-journal11:05:012
13482199250,24cyclictest3422186-21systemd-journal12:04:592
13482199250,24cyclictest3422186-21systemd-journal11:59:592
13481699250,24cyclictest0-21swapper/012:00:110
13483399240,3cyclictest1-21systemd12:30:007
13483399240,23cyclictest0-21swapper/708:40:127
13483099240,24cyclictest0-21swapper/607:35:136
13483099240,23cyclictest0-21swapper/609:50:126
13483099240,22cyclictest0-21swapper/609:00:006
13482899240,24cyclictest0-21swapper/508:00:185
13482899240,23cyclictest182829-21munin-run08:30:005
13482899240,21cyclictest0-21swapper/509:40:135
13482599240,23cyclictest322743-21awk12:25:004
13482299240,24cyclictest0-21swapper/308:20:023
13482299240,23cyclictest0-21swapper/307:35:133
134821992423,1cyclictest0-21swapper/207:15:012
134821992420,3cyclictest293152-21idleruntime-cro11:35:002
134818992423,1cyclictest251894-21munin-run10:25:001
134818992421,2cyclictest325670-21dump-pmu-power12:29:591
13481899240,23cyclictest0-21swapper/112:30:031
134816992423,1cyclictest326133-21apt-get12:30:110
134833992321,1cyclictest225391-21awk09:40:007
134833992319,3cyclictest215644-21dpkg09:22:287
13483399230,2cyclictest176839-21apt-get08:20:047
13483399230,22cyclictest218279-21ntpq09:25:187
13483399230,22cyclictest0-21swapper/712:10:127
13483399230,22cyclictest0-21swapper/707:20:127
13483099230,23cyclictest0-21swapper/608:20:046
13483099230,22cyclictest209840-21apt-get09:15:126
13483099230,22cyclictest0-21swapper/611:50:026
13483099230,1cyclictest137658-21munin-plugin-st07:15:006
13482899239,14cyclictest0-21swapper/512:20:405
13482899239,14cyclictest0-21swapper/510:52:485
13482899239,14cyclictest0-21swapper/508:19:025
13482899239,14cyclictest0-21swapper/507:35:065
13482899230,23cyclictest299079-21munin-plugin-st11:45:005
13482899230,23cyclictest0-21swapper/511:30:165
13482899230,23cyclictest0-21swapper/507:15:105
13482899230,0cyclictest0-21swapper/510:20:125
134825992323,0cyclictest0-21swapper/408:05:194
134825992321,1cyclictest215937-21apparmor_parser09:22:304
134825992321,1cyclictest185918-21latency_hist08:35:004
134825992321,1cyclictest156602-21apt-get07:45:114
134825992321,1cyclictest0-21swapper/409:45:004
13482599230,22cyclictest307939-21sendmail11:59:594
13482599230,22cyclictest231684-21apt-get09:50:124
13482599230,22cyclictest0-21swapper/410:35:004
13482599230,22cyclictest0-21swapper/409:10:004
13482599230,22cyclictest0-21swapper/407:40:124
134822992323,0cyclictest0-21swapper/311:35:033
134822992322,1cyclictest0-21swapper/307:15:113
134822992320,3cyclictest231262-21perf09:50:013
13482299230,23cyclictest0-21swapper/308:35:003
13482299230,23cyclictest0-21swapper/308:00:193
13482299230,22cyclictest243463-21apt-get10:10:143
13482299230,22cyclictest0-21swapper/308:10:133
13482299230,1cyclictest247717-21awk10:15:173
13482299230,0cyclictest0-21swapper/309:40:193
134821992323,0cyclictest0-21swapper/212:20:182
134821992322,1cyclictest0-21swapper/207:40:122
134821992321,1cyclictest0-21swapper/212:35:132
13482199230,22cyclictest293587-21apt-get11:35:122
13482199230,22cyclictest264103-21apt-get10:45:122
13482199230,1cyclictest0-21swapper/210:15:102
134818992321,1cyclictest275448-21cron11:05:011
134818992321,1cyclictest0-21swapper/108:50:041
13481899230,23cyclictest0-21swapper/112:00:101
13481899230,23cyclictest0-21swapper/111:30:101
13481899230,22cyclictest267044-21apt-get10:50:131
13481899230,22cyclictest212808-21apt-get09:20:131
13481899230,22cyclictest0-21swapper/107:25:041
13481899230,1cyclictest0-21swapper/111:50:201
134816992323,0cyclictest0-21swapper/007:20:190
134816992322,1cyclictest0-21swapper/009:45:110
134816992321,1cyclictest159544-21apt-get07:50:120
134816992318,4cyclictest200572-21sendmail09:00:010
13481699230,22cyclictest281764-21apt-get11:15:120
13481699230,22cyclictest0-21swapper/010:45:180
13481699230,1cyclictest171383-21apt-get08:10:120
13481699230,1cyclictest0-21swapper/007:35:190
13481699230,0cyclictest0-21swapper/012:20:110
134833992222,0cyclictest0-21swapper/711:30:107
134833992221,1cyclictest0-21swapper/708:15:197
134833992217,4cyclictest287239-21dump-pmu-power11:25:007
13483399220,22cyclictest205286-21ntpq09:05:187
13483399220,21cyclictest0-21swapper/712:30:117
13483399220,21cyclictest0-21swapper/712:20:117
13483399220,21cyclictest0-21swapper/712:00:117
13483399220,21cyclictest0-21swapper/711:50:127
13483399220,21cyclictest0-21swapper/710:00:137
13483399220,21cyclictest0-21swapper/710:00:137
13483399220,21cyclictest0-21swapper/709:55:137
13483399220,21cyclictest0-21swapper/709:55:127
13483399220,21cyclictest0-21swapper/709:50:117
13483399220,21cyclictest0-21swapper/708:35:007
13483399220,21cyclictest0-21swapper/707:40:137
13483399220,0cyclictest0-21swapper/710:45:127
134830992222,0cyclictest0-21swapper/611:20:146
134830992222,0cyclictest0-21swapper/609:25:036
134830992221,1cyclictest0-21swapper/611:30:006
134830992221,1cyclictest0-21swapper/609:22:416
134830992220,1cyclictest205352-21sh09:05:206
13483099220,22cyclictest0-21swapper/611:35:006
13483099220,22cyclictest0-21swapper/610:25:186
13483099220,22cyclictest0-21swapper/607:35:006
13483099220,21cyclictest269982-21apt-get10:55:116
13483099220,21cyclictest0-21swapper/612:15:116
13483099220,21cyclictest0-21swapper/609:45:116
13483099220,21cyclictest0-21swapper/609:30:196
13483099220,21cyclictest0-21swapper/608:45:116
13483099220,21cyclictest0-21swapper/608:05:136
13483099220,21cyclictest0-21swapper/607:55:126
13482899229,0cyclictest0-21swapper/512:31:395
13482899229,0cyclictest0-21swapper/512:09:415
13482899229,0cyclictest0-21swapper/511:47:435
13482899229,0cyclictest0-21swapper/511:25:465
13482899229,0cyclictest0-21swapper/509:13:585
13482899229,0cyclictest0-21swapper/507:57:055
13482899228,14cyclictest0-21swapper/508:08:035
134828992221,1cyclictest283063-21ntpq11:15:175
134828992221,1cyclictest211172-21ntpq09:15:185
134828992221,1cyclictest0-21swapper/512:35:135
134828992220,2cyclictest0-21swapper/511:00:175
134828992220,2cyclictest0-21swapper/509:25:175
134828992220,1cyclictest0-21swapper/508:10:125
134828992219,3cyclictest293122-21apt-get11:35:035
134828992219,2cyclictest144792-21apt-get07:25:135
13482899220,22cyclictest258201-21apt-get10:35:115
13482899220,22cyclictest141815-21apt-get07:20:125
13482899220,22cyclictest0-21swapper/512:30:005
13482899220,22cyclictest0-21swapper/508:50:025
13482899220,21cyclictest0-21swapper/509:35:135
134825992222,0cyclictest0-21swapper/411:25:124
134825992222,0cyclictest0-21swapper/407:10:134
134825992221,1cyclictest326133-21apt-get12:30:104
134825992220,1cyclictest0-21swapper/408:35:134
13482599220,21cyclictest313915-21appstreamcli12:10:014
13482599220,21cyclictest0-21swapper/411:45:114
13482599220,21cyclictest0-21swapper/411:35:134
13482599220,21cyclictest0-21swapper/411:20:204
13482599220,21cyclictest0-21swapper/409:25:024
13482599220,21cyclictest0-21swapper/408:25:004
13482599220,21cyclictest0-21swapper/407:20:124
13482599220,1cyclictest325739-21appstreamcli12:30:004
13482599220,1cyclictest275884-21apt-get11:05:114
13482599220,1cyclictest248936-21munin-run10:20:014
13482599220,1cyclictest150678-21apt-get07:35:134
134822992222,0cyclictest0-21swapper/312:10:023
134822992220,1cyclictest237584-21apt-get10:00:123
134822992220,1cyclictest237584-21apt-get10:00:123
134822992220,1cyclictest0-21swapper/312:10:003
13482299220,22cyclictest0-21swapper/310:35:113
13482299220,21cyclictest0-21swapper/311:15:123
13482299220,21cyclictest0-21swapper/310:20:143
13482299220,21cyclictest0-21swapper/309:25:113
13482299220,21cyclictest0-21swapper/308:50:023
13482299220,21cyclictest0-21swapper/307:50:123
13482299220,21cyclictest0-21swapper/307:40:123
13482299220,1cyclictest0-21swapper/309:30:113
13482299220,1cyclictest0-21swapper/309:22:173
134821992222,0cyclictest0-21swapper/210:10:182
134821992221,1cyclictest162484-21apt-get07:55:122
134821992220,1cyclictest219493-21appstreamcli09:30:022
13482199220,22cyclictest172658-21ntpq08:10:182
13482199220,21cyclictest0-21swapper/210:05:132
13482199220,21cyclictest0-21swapper/208:30:122
13482199220,21cyclictest0-21swapper/207:45:112
13482199220,21cyclictest0-21swapper/207:30:112
13482199220,21cyclictest0-21swapper/207:25:042
13482199220,1cyclictest209840-21apt-get09:15:122
13482199220,0cyclictest0-21swapper/210:50:122
13482199220,0cyclictest0-21swapper/208:35:122
134818992222,0cyclictest0-21swapper/112:20:181
134818992221,1cyclictest189199-21apt-get08:40:121
134818992221,1cyclictest0-21swapper/108:10:121
134818992220,1cyclictest0-21swapper/111:55:131
13481899220,22cyclictest283132-21ntpq11:15:191
13481899220,22cyclictest0-21swapper/111:45:171
13481899220,21cyclictest0-21swapper/111:35:121
13481899220,21cyclictest0-21swapper/111:10:121
13481899220,21cyclictest0-21swapper/111:05:121
13481899220,21cyclictest0-21swapper/110:25:121
13481899220,21cyclictest0-21swapper/109:40:121
13481899220,21cyclictest0-21swapper/109:15:121
13481899220,21cyclictest0-21swapper/108:35:021
13481899220,1cyclictest262505-21ntpq10:40:191
13481899220,1cyclictest165011-21perf07:59:591
13481899220,1cyclictest155003-21ntpq07:40:191
13481899220,1cyclictest0-21swapper/109:05:131
134816992222,0cyclictest0-21swapper/009:30:130
134816992221,1cyclictest304997-21grep11:54:590
134816992221,1cyclictest0-21swapper/011:30:100
134816992221,1cyclictest0-21swapper/009:50:120
134816992221,1cyclictest0-21swapper/007:45:110
134816992220,2cyclictest170963-21perf08:09:590
134816992220,1cyclictest234624-21apt-get09:55:130
134816992220,1cyclictest234624-21apt-get09:55:120
134816992220,1cyclictest0-21swapper/008:15:120
13481699220,22cyclictest286071-21ntpq11:20:200
13481699220,22cyclictest0-21swapper/010:50:130
13481699220,22cyclictest0-21swapper/008:25:010
13481699220,21cyclictest0-21swapper/011:35:030
13481699220,1cyclictest272943-21apt-get11:00:110
13481699220,1cyclictest0-21swapper/011:40:130
13481699220,1cyclictest0-21swapper/009:22:170
13481699220,1cyclictest0-21swapper/008:50:000
13481699220,0cyclictest0-21swapper/010:30:120
134833992121,0cyclictest0-21swapper/711:10:127
134833992121,0cyclictest0-21swapper/708:00:127
134833992120,1cyclictest261164-21apt-get10:40:137
134833992120,1cyclictest240526-21apt-get10:05:137
13483399210,21cyclictest252316-21apt-get10:25:117
13483399210,21cyclictest0-21swapper/711:55:197
13483399210,21cyclictest0-21swapper/711:05:177
13483399210,21cyclictest0-21swapper/709:40:127
13483399210,21cyclictest0-21swapper/709:15:007
13483399210,20cyclictest0-21swapper/711:15:137
13483399210,20cyclictest0-21swapper/710:55:127
13483399210,1cyclictest0-21swapper/708:50:007
13483399210,0cyclictest0-21swapper/709:30:047
134830992121,0cyclictest153662-21apt-get07:40:136
134830992121,0cyclictest0-21swapper/609:10:116
134830992121,0cyclictest0-21swapper/608:10:126
134830992120,1cyclictest329079-21apt-get12:35:126
134830992120,1cyclictest299504-21apt-get11:45:116
134830992120,1cyclictest277269-21ntpq11:05:186
134830992120,1cyclictest265409-21ntpq10:45:186
134830992120,1cyclictest0-21swapper/612:10:016
134830992120,1cyclictest0-21swapper/608:45:006
134830992120,1cyclictest0-21swapper/608:25:126
134830992120,1cyclictest0-21swapper/607:20:126
13483099210,21cyclictest314310-21apt-get12:10:136
13483099210,21cyclictest251882-21apt10:25:006
13483099210,21cyclictest0-21swapper/607:50:136
13483099210,1cyclictest325674-21munin-run12:29:596
13483099210,0cyclictest0-21swapper/608:35:016
13483099210,0cyclictest0-21swapper/607:25:136
13482899218,0cyclictest0-21swapper/507:13:095
134828992121,0cyclictest0-21swapper/511:05:115
134828992120,1cyclictest0-21swapper/512:04:595
134828992120,1cyclictest0-21swapper/509:00:005
134828992119,1cyclictest316821-21ls12:15:005
13482899210,21cyclictest305424-21apt-get11:55:125
13482899210,21cyclictest0-21swapper/509:30:115
13482899210,21cyclictest0-21swapper/508:35:045
13482899210,0cyclictest0-21swapper/508:20:125
134825992121,0cyclictest0-21swapper/411:00:174
134825992121,0cyclictest0-21swapper/408:55:184
134825992120,1cyclictest290608-21apt-get11:30:114
134825992120,1cyclictest192138-21apt-get08:45:114
134825992120,1cyclictest0-21swapper/408:10:124
134825992117,3cyclictest330384-21ntpq12:35:184
13482599210,21cyclictest0-21swapper/408:25:174
13482599210,20cyclictest0-21swapper/412:15:134
13482599210,20cyclictest0-21swapper/412:05:114
13482599210,20cyclictest0-21swapper/411:50:024
13482599210,20cyclictest0-21swapper/409:30:114
13482599210,20cyclictest0-21swapper/408:15:124
13482599210,1cyclictest228732-21apt-get09:45:124
13482599210,0cyclictest0-21swapper/408:00:134
134822992121,0cyclictest0-21swapper/312:20:123
134822992121,0cyclictest0-21swapper/311:50:123
134822992121,0cyclictest0-21swapper/309:50:123
134822992121,0cyclictest0-21swapper/308:55:113
134822992121,0cyclictest0-21swapper/307:55:113
134822992120,1cyclictest144323-21apt-get07:25:033
134822992120,1cyclictest0-21swapper/311:25:113
134822992120,1cyclictest0-21swapper/310:05:133
134822992120,1cyclictest0-21swapper/309:10:113
13482299210,21cyclictest302022-21munin-run11:49:593
13482299210,21cyclictest0-21swapper/312:30:023
13482299210,21cyclictest0-21swapper/311:55:123
13482299210,20cyclictest0-21swapper/307:45:113
13482299210,0cyclictest0-21swapper/308:35:123
134821992121,0cyclictest0-21swapper/211:25:002
134821992121,0cyclictest0-21swapper/210:40:122
134821992121,0cyclictest0-21swapper/209:45:172
134821992121,0cyclictest0-21swapper/209:05:122
134821992120,1cyclictest312624-21ntpq12:05:172
134821992120,1cyclictest222835-21apt-get09:35:122
134821992120,1cyclictest141415-21sendmail07:20:012
134821992120,1cyclictest0-21swapper/209:20:202
134821992120,1cyclictest0-21swapper/208:00:192
134821992119,1cyclictest0-21swapper/211:10:102
13482199210,21cyclictest202336-21ntpq09:00:182
13482199210,21cyclictest0-21swapper/208:50:042
13482199210,21cyclictest0-21swapper/208:40:122
13482199210,21cyclictest0-21swapper/207:20:202
13482199210,0cyclictest0-21swapper/212:30:122
13482199210,0cyclictest0-21swapper/211:25:182
13482199210,0cyclictest0-21swapper/209:55:132
13482199210,0cyclictest0-21swapper/209:55:122
13482199210,0cyclictest0-21swapper/208:20:032
134818992121,0cyclictest0-21swapper/110:10:181
134818992121,0cyclictest0-21swapper/107:45:111
134818992121,0cyclictest0-21swapper/107:15:011
134818992120,1cyclictest296560-21apt-get11:40:131
134818992120,1cyclictest287245-21munin-run11:25:001
134818992120,1cyclictest0-21swapper/107:20:201
134818992120,0cyclictest0-21swapper/107:15:101
134818992119,1cyclictest179903-21appstreamcli08:25:021
134818992119,1cyclictest0-21swapper/112:05:111
13481899210,21cyclictest0-21swapper/110:35:111
134816992121,0cyclictest0-21swapper/012:10:120
134816992121,0cyclictest0-21swapper/012:05:110
134816992121,0cyclictest0-21swapper/011:45:100
134816992120,1cyclictest0-21swapper/011:10:110
134816992120,1cyclictest0-21swapper/010:05:190
134816992120,0cyclictest0-21swapper/010:15:100
134816992119,1cyclictest317252-21apt-get12:15:120
13481699210,21cyclictest0-21swapper/007:25:030
13481699210,21cyclictest0-21swapper/007:10:190
13481699210,0cyclictest0-21swapper/008:40:120
134833992020,0cyclictest0-21swapper/711:00:117
134833992020,0cyclictest0-21swapper/710:50:127
134833992020,0cyclictest0-21swapper/708:55:127
134833992020,0cyclictest0-21swapper/708:29:427
134833992020,0cyclictest0-21swapper/708:05:137
134833992019,1cyclictest0-21swapper/710:10:137
134833992019,1cyclictest0-21swapper/707:55:177
134833992019,1cyclictest0-21swapper/707:50:187
13483399200,20cyclictest138846-21apt-get07:15:107
13483399200,19cyclictest153226-21perf07:40:017
134830992020,0cyclictest0-21swapper/611:10:126
134830992020,0cyclictest0-21swapper/610:50:136
134830992020,0cyclictest0-21swapper/610:00:126
134830992020,0cyclictest0-21swapper/610:00:116
134830992020,0cyclictest0-21swapper/608:35:036
134830992019,1cyclictest0-21swapper/608:20:006
13483099200,0cyclictest0-21swapper/609:35:196
13483099200,0cyclictest0-21swapper/608:50:026
13483099200,0cyclictest0-21swapper/607:45:126
134828992020,0cyclictest0-21swapper/510:45:125
134828992020,0cyclictest0-21swapper/507:50:135
134828992019,1cyclictest203960-21apt-get09:05:145
134828992019,1cyclictest0-21swapper/510:55:125
134825992020,0cyclictest0-21swapper/410:05:134
134825992019,1cyclictest0-21swapper/408:50:194
13482599200,20cyclictest0-21swapper/410:10:144
13482599200,19cyclictest278823-21apt-get11:10:114
13482599200,0cyclictest0-21swapper/409:10:124
134822992020,0cyclictest0-21swapper/312:35:133
134822992020,0cyclictest0-21swapper/311:20:133
134822992020,0cyclictest0-21swapper/310:55:123
134822992020,0cyclictest0-21swapper/310:50:133
134822992020,0cyclictest0-21swapper/310:35:003
134822992020,0cyclictest0-21swapper/308:45:123
134822992020,0cyclictest0-21swapper/308:40:133
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional