You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-20 - 18:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot4s.osadl.org (updated Thu Nov 20, 2025 12:44:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
7474862240179,19sleep60-21swapper/607:06:076
7474822233169,51sleep20-21swapper/207:06:022
7476982232170,19sleep40-21swapper/407:09:104
7475572230168,49sleep30-21swapper/307:07:073
7475232224185,26sleep50-21swapper/507:06:385
7475632216183,21sleep00-21swapper/007:07:130
7475142205177,18sleep70-21swapper/707:06:327
7476382202175,17sleep10-21swapper/107:08:181
74799399298,21cyclictest0-21swapper/710:00:007
74798799250,2cyclictest794354-21sh08:30:015
74797799250,3cyclictest771503-21perf07:50:003
74797099250,24cyclictest0-21swapper/008:40:000
74799199240,23cyclictest777209-21perf08:00:006
74798799240,1cyclictest925259-21apt-get12:15:125
747977992422,1cyclictest916703-21apt-get12:00:123
747977992421,2cyclictest780078-21munin-run08:04:593
74797799240,0cyclictest0-21swapper/307:10:133
74797699240,0cyclictest0-21swapper/212:30:122
74797299240,23cyclictest0-21swapper/107:50:121
747970992422,1cyclictest818184-21apt-get09:10:120
74797099240,23cyclictest890291-21basename11:15:010
74797099240,23cyclictest0-21swapper/009:55:120
74799399236,4cyclictest0-21swapper/711:44:107
74799399230,22cyclictest751876-21apt-get07:15:147
74799399230,22cyclictest0-21swapper/709:45:157
747991992323,0cyclictest0-21swapper/608:55:196
747991992319,3cyclictest788650-21perf08:19:596
74798799230,22cyclictest800078-21munin-run08:40:015
74798799230,22cyclictest0-21swapper/510:45:025
74798799230,22cyclictest0-21swapper/510:25:115
74798799230,22cyclictest0-21swapper/509:50:015
74798799230,21cyclictest893576-21apt-get11:20:135
747982992323,0cyclictest0-21swapper/410:10:014
747982992321,1cyclictest844179-21apt-get09:55:134
74798299230,23cyclictest794370-21munin-run08:30:004
74798299230,22cyclictest0-21swapper/412:20:114
74798299230,1cyclictest922407-21apt-get12:10:134
747977992321,1cyclictest882139-21apt-get11:00:133
74797699230,22cyclictest859011-21apt-get10:20:112
747972992321,1cyclictest928135-21apt-get12:20:121
74797299230,22cyclictest0-21swapper/111:10:101
747970992321,1cyclictest789086-21apt-get08:20:150
747970992320,2cyclictest826366-21awk09:25:000
74797099231,21cyclictest2278112-21in:imuxsock10:40:010
74797099230,22cyclictest0-21swapper/012:35:120
74799399220,21cyclictest0-21swapper/712:25:107
74799399220,21cyclictest0-21swapper/710:40:147
74799399220,21cyclictest0-21swapper/707:10:127
74799399220,1cyclictest882139-21apt-get11:00:147
74799399220,1cyclictest876410-21apt-get10:50:137
74799399220,0cyclictest0-21swapper/710:55:127
747991992222,0cyclictest0-21swapper/608:20:156
747991992221,1cyclictest0-21swapper/609:40:156
747991992220,1cyclictest853134-21packagekitd10:10:016
747991992220,1cyclictest826767-21apt-get09:25:116
747991992220,1cyclictest800518-21apt-get08:40:096
74799199220,21cyclictest0-21swapper/610:55:126
74799199220,21cyclictest0-21swapper/610:35:126
74799199220,1cyclictest921987-21munin-run12:10:006
747987992221,1cyclictest0-21swapper/511:20:015
747987992220,1cyclictest0-21swapper/512:35:125
74798799220,22cyclictest0-21swapper/511:50:135
74798799220,22cyclictest0-21swapper/509:40:005
74798799220,21cyclictest0-21swapper/512:10:005
74798799220,21cyclictest0-21swapper/508:15:155
74798799220,21cyclictest0-21swapper/507:50:115
747982992222,0cyclictest0-21swapper/409:45:164
747982992221,1cyclictest834951-21idleruntime-cro09:40:004
74798299220,21cyclictest0-21swapper/408:15:154
74798299220,1cyclictest760035-21munin-run07:29:594
747977992219,2cyclictest782922-21idleruntime-cro08:10:003
74797799220,21cyclictest0-21swapper/311:15:123
74797799220,21cyclictest0-21swapper/310:45:013
74797799220,21cyclictest0-21swapper/307:15:153
74797799220,0cyclictest0-21swapper/312:20:113
74797799220,0cyclictest0-21swapper/311:50:013
74797799220,0cyclictest0-21swapper/309:50:023
74797799220,0cyclictest0-21swapper/307:25:123
747976992220,1cyclictest797225-21munin-run08:35:002
747976992220,1cyclictest0-21swapper/207:30:002
74797699220,21cyclictest0-21swapper/212:05:112
74797699220,21cyclictest0-21swapper/211:05:102
74797699220,21cyclictest0-21swapper/211:00:142
74797699220,21cyclictest0-21swapper/210:50:132
74797699220,1cyclictest916273-21systemctl12:00:002
74797699220,1cyclictest0-21swapper/207:20:122
747972992222,0cyclictest0-21swapper/111:15:111
747972992222,0cyclictest0-21swapper/107:10:121
74797299220,21cyclictest0-21swapper/109:47:231
747970992222,0cyclictest0-21swapper/008:40:090
747970992220,1cyclictest922407-21apt-get12:10:120
747970992220,1cyclictest890695-21apt-get11:15:110
74797099220,21cyclictest0-21swapper/009:00:000
74797099220,1cyclictest768652-21awk07:44:590
7809792210,1chrt0-21swapper/208:05:122
747993992121,0cyclictest0-21swapper/709:35:107
747993992120,1cyclictest0-21swapper/711:45:157
747993992119,1cyclictest0-21swapper/708:00:007
74799399210,0cyclictest916703-21apt-get12:00:137
74799399210,0cyclictest0-21swapper/711:25:167
74799399210,0cyclictest0-21swapper/710:20:127
74799399210,0cyclictest0-21swapper/709:40:157
747991992121,0cyclictest0-21swapper/610:25:126
747991992120,1cyclictest896429-21apt-get11:25:156
74799199210,21cyclictest0-21swapper/612:39:596
74799199210,21cyclictest0-21swapper/611:10:016
74799199210,21cyclictest0-21swapper/609:47:246
74799199210,21cyclictest0-21swapper/608:40:006
747987992120,1cyclictest802967-21awk08:45:005
747987992120,1cyclictest0-21swapper/510:40:005
747987992120,1cyclictest0-21swapper/509:30:125
747987992120,0cyclictest0-21swapper/510:10:025
747987992119,1cyclictest0-21swapper/507:55:095
74798799210,20cyclictest0-21swapper/509:00:015
74798799210,1cyclictest0-21swapper/511:35:115
747982992121,0cyclictest0-21swapper/409:25:124
747982992120,1cyclictest0-21swapper/410:25:014
747982992119,2cyclictest890695-21apt-get11:15:124
747982992119,1cyclictest818184-21apt-get09:10:114
747982992118,2cyclictest650-21dbus-daemon07:20:004
74798299210,21cyclictest0-21swapper/412:30:134
74798299210,21cyclictest0-21swapper/411:55:104
74798299210,21cyclictest0-21swapper/410:55:124
74798299210,21cyclictest0-21swapper/408:30:174
74798299210,20cyclictest0-21swapper/408:50:124
74798299210,1cyclictest808647-21apt-get08:55:024
747977992121,0cyclictest0-21swapper/310:10:143
747977992121,0cyclictest0-21swapper/309:30:133
747977992121,0cyclictest0-21swapper/307:40:133
747977992119,1cyclictest0-21swapper/312:35:013
747977992119,1cyclictest0-21swapper/308:30:163
74797799210,20cyclictest0-21swapper/309:00:133
74797799210,0cyclictest0-21swapper/312:25:093
74797799210,0cyclictest0-21swapper/310:55:133
747976992121,0cyclictest0-21swapper/208:10:132
747976992121,0cyclictest0-21swapper/207:35:112
747976992119,1cyclictest881709-21awk11:00:012
747976992119,1cyclictest817772-21perf09:10:012
74797699210,21cyclictest876004-21idleruntime-cro10:50:002
74797699210,21cyclictest0-21swapper/210:40:012
74797699210,0cyclictest0-21swapper/208:50:122
74797699210,0cyclictest0-21swapper/208:35:152
747972992121,0cyclictest0-21swapper/111:50:001
747972992121,0cyclictest0-21swapper/109:50:011
747972992121,0cyclictest0-21swapper/107:30:131
747972992121,0cyclictest0-21swapper/107:25:121
747972992120,1cyclictest0-21swapper/110:55:131
747972992120,0cyclictest0-21swapper/112:25:101
74797299210,20cyclictest0-21swapper/112:30:121
74797299210,1cyclictest0-21swapper/108:00:001
74797299210,0cyclictest0-21swapper/110:00:021
74797299210,0cyclictest0-21swapper/108:55:131
747970992121,0cyclictest0-21swapper/009:00:110
747970992121,0cyclictest0-21swapper/008:00:130
747970992120,1cyclictest0-21swapper/008:45:120
747993992020,0cyclictest0-21swapper/712:10:127
747993992020,0cyclictest0-21swapper/711:55:117
747993992020,0cyclictest0-21swapper/711:10:117
747993992020,0cyclictest0-21swapper/709:30:127
747993992020,0cyclictest0-21swapper/709:20:107
747993992020,0cyclictest0-21swapper/708:45:127
747993992018,1cyclictest852589-21apt-get10:10:027
747991992020,0cyclictest0-21swapper/611:45:156
747991992020,0cyclictest0-21swapper/611:35:126
747991992020,0cyclictest0-21swapper/609:35:106
747991992020,0cyclictest0-21swapper/609:15:126
747991992019,1cyclictest843783-21awk09:55:006
747991992019,1cyclictest761rcuc/611:45:016
747991992019,0cyclictest0-21swapper/612:00:136
747987992020,0cyclictest0-21swapper/510:05:115
747987992020,0cyclictest0-21swapper/509:40:155
747987992020,0cyclictest0-21swapper/509:20:125
747987992020,0cyclictest0-21swapper/509:00:025
747987992020,0cyclictest0-21swapper/508:20:145
747987992020,0cyclictest0-21swapper/508:10:115
747987992019,1cyclictest0-21swapper/511:00:135
74798799200,1cyclictest916300-21idleruntime-cro11:59:595
747982992020,0cyclictest0-21swapper/411:35:124
747982992020,0cyclictest0-21swapper/410:40:124
747982992020,0cyclictest0-21swapper/410:05:114
747982992020,0cyclictest0-21swapper/410:00:114
747982992019,1cyclictest791520-21perf08:24:594
74798299200,20cyclictest0-21swapper/412:40:004
74798299200,20cyclictest0-21swapper/407:10:134
74798299200,0cyclictest0-21swapper/411:05:104
747977992020,0cyclictest0-21swapper/312:30:113
747977992020,0cyclictest0-21swapper/311:10:093
747977992020,0cyclictest0-21swapper/310:40:123
747977992020,0cyclictest0-21swapper/309:40:143
747977992020,0cyclictest0-21swapper/308:55:013
747977992019,1cyclictest0-21swapper/310:00:123
747977992019,0cyclictest0-21swapper/309:15:113
74797799200,0cyclictest0-21swapper/308:50:123
747976992020,0cyclictest0-21swapper/212:20:112
747976992020,0cyclictest0-21swapper/211:30:142
747976992020,0cyclictest0-21swapper/210:30:132
747976992020,0cyclictest0-21swapper/209:35:012
747976992020,0cyclictest0-21swapper/209:10:132
747976992020,0cyclictest0-21swapper/207:10:122
747976992019,1cyclictest812468-21apt-get09:00:112
747976992019,1cyclictest0-21swapper/209:25:112
747976992019,0cyclictest0-21swapper/210:00:122
74797699200,20cyclictest777203-21munin-run07:59:592
74797699200,0cyclictest0-21swapper/207:45:142
747972992020,0cyclictest0-21swapper/112:10:121
747972992020,0cyclictest0-21swapper/112:05:111
747972992020,0cyclictest0-21swapper/111:55:111
747972992020,0cyclictest0-21swapper/110:45:011
747972992020,0cyclictest0-21swapper/110:25:121
747972992020,0cyclictest0-21swapper/109:00:011
747972992020,0cyclictest0-21swapper/108:50:131
747972992020,0cyclictest0-21swapper/107:40:121
747972992019,1cyclictest0-21swapper/108:35:001
74797299200,19cyclictest0-21swapper/112:00:121
747970992020,0cyclictest0-21swapper/011:40:110
747970992018,1cyclictest0-21swapper/007:40:000
74799399196,13cyclictest0-21swapper/712:17:077
74799399196,0cyclictest0-21swapper/710:27:177
74799399196,0cyclictest0-21swapper/707:20:347
747993991919,0cyclictest0-21swapper/712:20:127
747993991919,0cyclictest0-21swapper/708:30:107
747993991919,0cyclictest0-21swapper/708:10:157
747993991918,1cyclictest765768-21munin-run07:40:007
74799399190,18cyclictest0-21swapper/708:40:097
74799399190,18cyclictest0-21swapper/707:45:137
747991991919,0cyclictest0-21swapper/611:15:116
747991991919,0cyclictest0-21swapper/610:45:126
747991991919,0cyclictest0-21swapper/610:15:136
747991991919,0cyclictest0-21swapper/608:05:126
747991991918,1cyclictest0-21swapper/611:15:016
747987991919,0cyclictest0-21swapper/509:50:195
747987991918,1cyclictest1-21systemd11:45:015
747987991917,1cyclictest928135-21apt-get12:20:105
747987991915,3cyclictest881715-21awk11:00:005
747982991919,0cyclictest0-21swapper/410:50:144
747982991919,0cyclictest0-21swapper/408:00:124
747982991918,1cyclictest0-21swapper/410:35:124
747982991918,1cyclictest0-21swapper/409:20:124
747977991919,0cyclictest0-21swapper/312:10:123
747977991919,0cyclictest0-21swapper/311:55:103
747977991919,0cyclictest0-21swapper/311:40:123
747977991919,0cyclictest0-21swapper/311:30:153
747977991919,0cyclictest0-21swapper/310:05:113
747977991919,0cyclictest0-21swapper/307:20:123
747977991918,1cyclictest0-21swapper/310:00:013
747977991917,1cyclictest864294-21turbostat10:30:013
74797799190,18cyclictest762890-21munin-run07:34:593
747976991919,0cyclictest0-21swapper/212:10:132
747976991919,0cyclictest0-21swapper/209:55:132
747976991919,0cyclictest0-21swapper/209:50:132
747976991919,0cyclictest0-21swapper/207:40:122
747976991918,1cyclictest0-21swapper/207:15:152
747976991918,0cyclictest0-21swapper/208:15:162
747976991917,1cyclictest939394-21munin-run12:39:592
74797699190,18cyclictest0-21swapper/210:45:002
747972991919,0cyclictest815330-21apt-get09:05:101
747972991919,0cyclictest0-21swapper/107:15:141
747972991918,1cyclictest854528-21ntpq10:10:211
747972991918,1cyclictest829624-21apt-get09:30:131
747972991917,1cyclictest0-21swapper/110:40:131
747970991919,0cyclictest0-21swapper/012:20:110
747970991919,0cyclictest0-21swapper/011:00:140
747970991919,0cyclictest0-21swapper/008:50:140
747970991919,0cyclictest0-21swapper/008:05:110
747970991917,1cyclictest930984-21apt-get12:25:100
747970991917,1cyclictest904565-21turbostat11:40:010
747970991917,1cyclictest0-21swapper/010:20:000
747970991917,1cyclictest0-21swapper/008:19:590
74799399185,0cyclictest0-21swapper/710:16:197
74799399185,0cyclictest0-21swapper/708:59:257
74799399185,0cyclictest0-21swapper/707:31:347
747993991818,0cyclictest846603-21apt-get10:00:027
747993991818,0cyclictest0-21swapper/711:20:137
747993991818,0cyclictest0-21swapper/709:00:117
747993991816,1cyclictest808649-21dump-pmu-power08:55:017
747991991818,0cyclictest0-21swapper/610:30:126
747991991817,1cyclictest0-21swapper/607:30:116
747987991818,0cyclictest0-21swapper/512:30:135
747987991818,0cyclictest0-21swapper/512:00:135
747987991818,0cyclictest0-21swapper/507:30:125
747987991817,1cyclictest0-21swapper/511:50:015
747987991817,1cyclictest0-21swapper/507:45:135
747987991816,1cyclictest884987-21apt-get11:05:105
747982991818,0cyclictest0-21swapper/411:00:134
747982991816,1cyclictest930984-21apt-get12:25:094
747977991818,0cyclictest0-21swapper/310:20:123
747977991818,0cyclictest0-21swapper/309:20:123
747977991818,0cyclictest0-21swapper/308:45:123
747977991817,1cyclictest501ktimers/312:16:543
747977991816,1cyclictest0-21swapper/310:35:013
747977991816,1cyclictest0-21swapper/309:50:003
74797799180,0cyclictest0-21swapper/308:25:093
747976991818,0cyclictest0-21swapper/210:25:132
74797699180,17cyclictest0-21swapper/209:45:222
747972991818,0cyclictest0-21swapper/108:25:101
747972991818,0cyclictest0-21swapper/108:04:591
747972991816,2cyclictest846674-21dpkg10:00:001
747972991816,1cyclictest0-21swapper/108:09:591
747970991818,0cyclictest0-21swapper/012:30:110
747970991818,0cyclictest0-21swapper/011:55:110
747970991818,0cyclictest0-21swapper/011:45:150
747970991818,0cyclictest0-21swapper/010:50:130
747970991818,0cyclictest0-21swapper/010:25:110
747970991818,0cyclictest0-21swapper/010:10:150
747970991818,0cyclictest0-21swapper/010:05:120
747970991818,0cyclictest0-21swapper/009:47:230
74797099180,17cyclictest0-21swapper/009:40:150
747993991717,0cyclictest0-21swapper/711:50:137
747993991717,0cyclictest0-21swapper/711:15:117
747993991717,0cyclictest0-21swapper/710:35:007
747993991717,0cyclictest0-21swapper/709:15:127
747993991716,1cyclictest0-21swapper/710:10:017
747993991716,1cyclictest0-21swapper/708:25:097
747993991715,1cyclictest826767-21apt-get09:25:107
747991991717,0cyclictest0-21swapper/612:10:126
747991991717,0cyclictest0-21swapper/608:30:016
747991991716,1cyclictest820634-21awk09:15:016
747991991716,1cyclictest0-21swapper/610:00:006
747991991716,1cyclictest0-21swapper/607:29:596
747991991715,1cyclictest933842-21apt-get12:30:136
747991991715,1cyclictest805808-21perf08:50:006
747987991717,0cyclictest0-21swapper/511:30:145
747987991717,0cyclictest0-21swapper/509:15:125
747987991717,0cyclictest0-21swapper/508:50:145
747987991717,0cyclictest0-21swapper/508:30:115
747987991717,0cyclictest0-21swapper/507:40:135
747987991717,0cyclictest0-21swapper/507:20:115
747987991716,0cyclictest0-21swapper/507:25:115
747987991715,1cyclictest849748-21munin-run10:05:005
74798799170,16cyclictest887841-21apt-get11:10:105
74798799170,16cyclictest0-21swapper/509:15:005
747982991717,0cyclictest0-21swapper/412:15:124
747982991717,0cyclictest0-21swapper/409:05:094
747982991717,0cyclictest0-21swapper/409:00:024
74797799170,16cyclictest0-21swapper/311:23:563
747976991717,0cyclictest0-21swapper/212:15:132
747976991717,0cyclictest0-21swapper/209:35:092
747972991717,0cyclictest0-21swapper/111:00:141
747972991717,0cyclictest0-21swapper/109:40:141
747972991716,1cyclictest905008-21apt-get11:40:111
747972991716,1cyclictest0-21swapper/111:30:161
747972991716,0cyclictest0-21swapper/112:35:001
747972991715,2cyclictest771478-21cron07:49:591
74797299170,16cyclictest0-21swapper/107:20:111
747970991717,0cyclictest0-21swapper/011:20:130
747970991717,0cyclictest0-21swapper/007:49:590
747970991717,0cyclictest0-21swapper/007:25:110
747970991715,1cyclictest887424-21munin-run11:10:010
747970991715,1cyclictest821036-21apt-get09:15:120
747993991616,0cyclictest0-21swapper/709:50:127
747993991616,0cyclictest0-21swapper/708:20:157
747993991616,0cyclictest0-21swapper/707:50:137
74799399160,16cyclictest0-21swapper/707:28:287
74799399160,15cyclictest0-21swapper/711:05:517
747991991616,0cyclictest0-21swapper/612:20:116
747991991616,0cyclictest0-21swapper/612:15:126
747991991616,0cyclictest0-21swapper/611:00:136
747991991616,0cyclictest0-21swapper/610:10:026
747991991616,0cyclictest0-21swapper/609:30:116
747991991615,1cyclictest0-21swapper/607:20:116
747991991614,1cyclictest913825-21apt-get11:55:106
747991991614,1cyclictest870444-21apt-get10:40:136
747991991614,1cyclictest806226-21apt-get08:50:136
747987991616,0cyclictest0-21swapper/512:10:125
747982991616,0cyclictest0-21swapper/411:20:144
747982991616,0cyclictest0-21swapper/407:45:144
747982991616,0cyclictest0-21swapper/407:30:124
747982991615,1cyclictest771915-21apt-get07:50:114
747982991615,1cyclictest0-21swapper/411:30:004
747982991615,1cyclictest0-21swapper/411:10:104
747982991615,1cyclictest0-21swapper/409:50:024
747982991615,1cyclictest0-21swapper/407:40:134
747982991612,3cyclictest910976-21apt-get11:50:144
74798299160,2cyclictest837777-21latency_hist09:45:004
747977991616,0cyclictest0-21swapper/311:50:143
747977991616,0cyclictest0-21swapper/309:10:123
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional