You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-08-13 - 01:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

x86 Intel Pentium N4200 @1100 MHz, Linux 5.9.1-rt18 (Profile)

Latency plot of shadow in rack #c, slot #4
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot4s.osadl.org (updated Fri Aug 12, 2022 12:44:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
54982316269,34sleep30-21swapper/307:08:143
55922267220,34sleep00-21swapper/007:09:040
55262260204,42sleep20-21swapper/207:08:282
53952257200,46sleep10-21swapper/107:07:181
34221340,1sleep30-21swapper/310:35:163
301921290,3sleep09-21ksoftirqd/011:55:170
1226321240,2sleep0594099cyclictest12:15:130
135812520,1sleep00-21swapper/007:25:160
263792470,6sleep225-21ksoftirqd/207:55:012
203162460,2sleep0101rcuc/011:20:160
90112410,1sleep20-21swapper/210:55:002
227262410,2sleep20-21swapper/211:25:182
216542390,2chrt0-21swapper/212:35:192
311502350,4chrt31157-21cron09:20:003
136972340,2sleep10-21swapper/107:25:181
594999292,23cyclictest26674-40apt-check07:55:062
594999283,21cyclictest14606-21apt-get12:20:152
594999273,19cyclictest31077-21apt-get08:05:132
594999272,11cyclictest20506-21taskset08:55:122
594999262,6cyclictest21999-21apt-get07:45:132
5949992612,8cyclictest17612-21apt-get07:35:132
594499264,18cyclictest31650-21grep10:30:291
594999252,5cyclictest7428-21apt-get08:25:132
594999252,4cyclictest29229-21apt-get09:15:172
594999251,7cyclictest17401-21wc07:35:012
5940992514,7cyclictest5171-21apt-get12:00:170
111712250,3sleep30-21swapper/310:59:593
594999242,4cyclictest7359-21apt-get12:05:202
594999242,4cyclictest7359-21apt-get12:05:202
594499242,14cyclictest6363-21apt-get10:50:141
594499242,14cyclictest4570-21kworker/u8:012:10:061
594499242,14cyclictest4570-21kworker/u8:012:10:061
594999232,17cyclictest10962-21apt-get07:20:142
594999231,3cyclictest8532-21munin-run07:15:002
594999231,18cyclictest27872-21lsb_release10:25:002
594499239,9cyclictest13524-21apt-get11:05:151
594499232,14cyclictest15049-21apt-esm-hook09:55:171
594499232,13cyclictest17886-21apt-esm-hook11:15:151
5944992313,6cyclictest28594-21basename11:40:011
5949992217,3cyclictest9849-40apt-check12:10:072
5949992217,3cyclictest9849-40apt-check12:10:072
5949992214,6cyclictest5791-21cat08:20:172
594999221,3cyclictest11115-21lsb_release11:00:002
594999221,18cyclictest30035-21munin-run10:30:002
594999221,18cyclictest11778-21apt-get08:35:122
594999221,16cyclictest0-21swapper/211:55:182
594999220,5cyclictest22005-21munin-run11:25:012
594999220,21cyclictest0-21swapper/209:35:012
594999220,19cyclictest10627-40apt-check09:45:062
594499222,13cyclictest747-21apt-get11:50:141
5944992214,6cyclictest19747-21ntpq12:30:241
5944992213,5cyclictest31777-21runrttasks09:20:131
594499221,14cyclictest26674-40apt-check07:55:051
5944992210,8cyclictest18069-21cron08:49:591
594499220,5cyclictest0-21swapper/108:41:341
594499220,4cyclictest0-21swapper/108:12:201
5940992215,4cyclictest14341-21sh11:05:220
5940992213,7cyclictest16684-21cat08:45:170
90712210,2sleep10-21swapper/107:15:161
595499212,14cyclictest26754-21taskset07:55:183
5954992114,5cyclictest4132-21perl09:30:243
5954992114,5cyclictest17995-21ntpq10:00:253
5954992113,6cyclictest21088-21which11:20:243
5954992113,5cyclictest16970-21sendmail10:00:003
594999212,17cyclictest0-21swapper/209:20:112
5949992117,2cyclictest30299-21sh10:30:162
5949992114,5cyclictest9367-21sed07:15:182
5949992114,5cyclictest14037-21https12:20:012
5949992114,4cyclictest18963-21apt-get12:30:182
5949992113,6cyclictest23242-21awk09:00:172
594999211,16cyclictest17868-21apt-get11:15:152
594999211,16cyclictest1568-21apt-get09:25:162
594999211,14cyclictest23728-21apt-get10:15:142
594999211,13cyclictest21578-21runrttasks10:10:142
594499218,9cyclictest3761-21apt-get09:30:201
594499212,13cyclictest24192-21apt-esm-hook07:50:121
594499212,13cyclictest20536-21apt-esm-hook08:55:131
594499212,13cyclictest18345-21apt-esm-hook08:50:131
594499212,12cyclictest11778-21apt-get08:35:131
5944992113,6cyclictest6529-21date10:50:001
594499211,14cyclictest7234-21cat08:25:001
594499211,13cyclictest22018-21apt-esm-hook07:45:121
594499210,5cyclictest0-21swapper/110:27:541
5940992113,6cyclictest4435-21users08:15:260
5940992110,8cyclictest24428-21apt-get11:30:200
595499202,12cyclictest13163-21apt-esm-hook07:25:133
5954992015,3cyclictest19491-21timerandwakeup08:50:253
5954992014,3cyclictest5488-21runrttasks10:45:243
5954992013,5cyclictest702-21sed08:10:013
5954992013,5cyclictest22378-21awk10:10:223
5954992013,5cyclictest17981-21fw_packets07:35:153
595499201,14cyclictest16786-21chrt12:25:143
595499201,13cyclictest5943-21apt-esm-hook09:35:143
594999209,7cyclictest19388-21apt-get10:05:172
594999203,15cyclictest17746-21cat11:15:012
594999202,13cyclictest28905-21apt-get08:00:122
5949992012,6cyclictest5019-21awk08:20:002
5949992012,4cyclictest11399-21grep08:33:572
594999201,16cyclictest469-21cron11:50:002
594999201,13cyclictest2295-21apt-esm-hook10:40:132
594999201,13cyclictest16165-21apt-esm-hook08:45:132
5949992010,8cyclictest1319-21cat11:50:172
594999200,16cyclictest19143-21lsb_release10:04:592
594499203,9cyclictest17304-21lsb_release07:35:011
594499203,10cyclictest9624-21apt-esm-hook08:30:131
594499202,12cyclictest31049-21apt-esm-hook11:45:201
594499202,12cyclictest25454-21apt-get11:30:311
594499202,12cyclictest23745-21apt-esm-hook10:15:151
594499202,12cyclictest2255-21apt-get10:40:141
594499202,11cyclictest16821-21apt-esm-hook12:25:161
594499202,11cyclictest1607-21cut09:25:161
594499202,11cyclictest1124-21runrttasks11:10:171
5944992013,5cyclictest6398-21sed09:35:171
5944992013,4cyclictest24876-21runrttasks09:05:121
594499201,13cyclictest9185-21apt-esm-hook10:55:131
594499201,13cyclictest21787-21grep07:45:011
594499201,13cyclictest10627-40apt-check09:45:071
594499201,12cyclictest22257-21apt-esm-hook11:25:151
594499200,5cyclictest0-21swapper/109:12:241
594499200,4cyclictest0-21swapper/111:03:561
594499200,4cyclictest0-21swapper/110:11:121
594499200,4cyclictest0-21swapper/110:09:071
594499200,4cyclictest0-21swapper/108:16:311
594499200,4cyclictest0-21swapper/108:02:181
594099202,12cyclictest7003-21apt-esm-hook10:50:190
5940992015,2cyclictest26805-21cpu07:55:170
5940992014,3cyclictest1823-21processes08:10:200
5940992013,5cyclictest14758-21ntpq08:40:210
5940992013,5cyclictest1166-21cat10:35:260
5940992012,6cyclictest31328-21entropy08:05:150
5940992012,6cyclictest30512-21df_inode10:30:180
5940992012,6cyclictest17445-21df10:00:200
594099201,13cyclictest7428-21apt-get08:25:140
594099201,13cyclictest5926-21apt-get09:35:140
594099201,13cyclictest12865-21apt-esm-hook09:50:200
100972200,2sleep30-21swapper/312:10:173
100972200,2sleep30-21swapper/312:10:173
595499199,7cyclictest20502-21apt-get08:55:123
595499199,6cyclictest520-21sort11:49:593
595499197,7cyclictest24870-21apt-get09:05:133
5954991914,3cyclictest20190-21timerwakeupswit12:30:303
5954991913,3cyclictest815-21runrttasks09:20:543
5954991912,5cyclictest858-21ls11:50:133
5954991912,5cyclictest8372-21df09:40:173
5954991912,5cyclictest6586-21grep08:20:263
5954991912,5cyclictest31-21ksoftirqd/311:10:233
5954991912,5cyclictest24394-21ls10:15:203
5954991911,6cyclictest20653-21grep10:05:303
595499191,13cyclictest8797-21apt-esm-hook07:15:133
595499191,13cyclictest7447-21apt-esm-hook08:25:133
595499191,13cyclictest5191-21apt-esm-hook12:00:173
595499191,12cyclictest9605-21apt-get08:30:133
595499191,12cyclictest28848-21apt-esm-hook11:40:143
595499191,12cyclictest28101-21apt-get10:25:153
595499191,12cyclictest1568-21apt-get09:25:163
5949991914,3cyclictest1887-21snmpd11:33:592
5949991913,4cyclictest4970-21cat10:45:172
594999191,13cyclictest5966-21apt-esm-hook09:35:142
594999191,13cyclictest24870-21apt-get09:05:132
594999190,3cyclictest2787-21cron08:15:002
594499199,6cyclictest23043-21cron12:39:591
594499193,9cyclictest25933-21apt-get10:20:161
594499192,12cyclictest3012-21apt-esm-hook11:55:171
594499192,11cyclictest7377-21apt-esm-hook12:05:191
594499192,11cyclictest7377-21apt-esm-hook12:05:191
5944991912,5cyclictest8618-21sed08:25:251
5944991912,5cyclictest21274-21grep11:20:281
5944991912,4cyclictest14096-21apt-key12:20:001
5944991911,5cyclictest19547-21sh07:40:011
594499191,13cyclictest29229-21apt-get09:15:171
594499191,13cyclictest10976-21apt-esm-hook07:20:141
594499191,12cyclictest17254-21apt-esm-hook10:00:191
5940991915,2cyclictest3236-21sendmail_mailqu10:40:220
5940991914,3cyclictest29254-21sh09:15:170
5940991913,4cyclictest22534-21cat07:45:170
5940991912,5cyclictest4812-21grep10:45:170
5940991912,5cyclictest4247-21basename09:30:250
5940991912,5cyclictest15416-21grep09:55:200
5940991911,5cyclictest12558-21ntp_kernel_err08:35:210
594099191,11cyclictest31030-21apt-esm-hook11:45:190
595499187,8cyclictest11778-21apt-get08:35:123
5954991815,2cyclictest6604-21apt-esm-hook07:10:133
5954991815,2cyclictest1887-21snmpd11:33:433
5954991813,3cyclictest28972-21latency_hist09:15:003
5954991812,4cyclictest15099-21cat08:40:253
5954991812,3cyclictest0-21swapper/312:05:183
5954991812,3cyclictest0-21swapper/312:05:183
5954991811,5cyclictest12186-21cat07:20:273
595499181,12cyclictest1887-21snmpd09:50:203
595499181,12cyclictest1887-21snmpd07:40:113
595499181,12cyclictest17868-21apt-get11:15:153
595499181,12cyclictest14623-21apt-esm-hook12:20:143
595499181,12cyclictest10662-21apt-get09:45:143
5954991810,5cyclictest24833-21wc07:50:193
5954991810,5cyclictest12348-21which11:00:293
5949991813,3cyclictest14774-21perf09:54:592
5949991813,3cyclictest14416-21sed08:40:172
5949991811,5cyclictest29071-21date09:15:002
5949991811,5cyclictest19038-21sed08:50:182
594999181,13cyclictest19827-21apt-get07:40:132
594999181,12cyclictest5210-21apt-esm-hook12:00:182
594999181,12cyclictest26672-21apt-esm-hook11:35:152
594999181,12cyclictest16783-21apt-get12:25:182
594499183,9cyclictest5171-21apt-get12:00:171
5944991814,2cyclictest6392-21kernelversion07:10:031
5944991811,5cyclictest23947-21sed09:00:251
594499181,12cyclictest13985-21apt-get12:20:061
5940991814,2cyclictest31516-21apt-config09:20:010
5940991814,2cyclictest24919-21cpu09:05:140
5940991814,2cyclictest10545-21vmstat10:55:260
5940991812,4cyclictest882-21wc11:50:130
5940991811,5cyclictest7555-21ls12:05:200
5940991811,5cyclictest7555-21ls12:05:200
5940991811,5cyclictest28973-21expr11:40:150
5940991811,5cyclictest22118-21which12:35:240
5940991811,5cyclictest14768-21expr12:20:140
5940991811,4cyclictest9940-21cat07:15:250
594099181,12cyclictest26635-21apt-get11:35:140
594099181,12cyclictest23764-21apt-esm-hook10:15:150
594099181,12cyclictest22278-21apt-esm-hook11:25:140
594099181,12cyclictest11375-21apt-esm-hook11:00:210
594099181,11cyclictest27050-21apt-get09:10:140
5940991810,6cyclictest11294-21tune2fs07:20:170
5940991810,5cyclictest28876-21nfs4_client10:25:230
595499178,5cyclictest31-21ksoftirqd/311:55:173
5954991713,2cyclictest2745-21idleruntime10:40:163
5954991712,4cyclictest12750-21sed12:15:183
5954991712,3cyclictest29496-21expr08:00:193
5954991712,3cyclictest22273-21timerandwakeup12:35:283
5954991712,2cyclictest30562-21grep10:30:183
5954991711,4cyclictest8904-21cron10:54:593
5954991711,4cyclictest15472-21grep07:30:153
595499171,12cyclictest3064-21apt-esm-hook08:15:143
595499171,12cyclictest21999-21apt-get07:45:133
595499171,11cyclictest885-21apt-esm-hook08:10:133
595499171,11cyclictest26652-21apt-esm-hook11:35:143
595499171,11cyclictest22715-21apt-esm-hook09:00:133
5954991710,5cyclictest28018-21cut10:25:003
5954991710,4cyclictest16655-21if_enp2s008:45:163
594999173,8cyclictest11361-21apt-get11:00:202
5949991713,2cyclictest13142-21/usr/sbin/munin07:25:152
594999171,14cyclictest30772-21perf11:45:002
5949991711,4cyclictest15514-21wc11:10:012
5949991711,3cyclictest32447-21runrttasks10:35:132
594999171,11cyclictest8167-21apt-esm-hook09:40:152
594499174,8cyclictest32443-21apt-get10:35:151
5944991713,2cyclictest8171-21sh09:40:151
594499171,11cyclictest12885-21apt-esm-hook09:50:201
5944991710,5cyclictest32264-21sed08:05:251
594499170,14cyclictest29120-21sort11:40:171
5940991713,2cyclictest9881-21/usr/sbin/munin12:10:200
5940991713,2cyclictest9881-21/usr/sbin/munin12:10:200
5940991713,2cyclictest23661-21rt-features09:00:230
5940991713,2cyclictest21562-21sh10:10:150
5940991713,2cyclictest17605-21cron11:15:000
5940991713,2cyclictest15347-21apt07:30:130
5940991712,3cyclictest6231-21open_files07:10:020
5940991711,4cyclictest9954-21grep08:30:160
5940991711,4cyclictest26973-21grep10:20:280
5940991711,4cyclictest21809-21sed08:55:260
5940991711,4cyclictest20281-21basename08:55:010
594099171,12cyclictest28905-21apt-get08:00:140
594099171,12cyclictest19865-21apt-esm-hook07:40:120
594099171,11cyclictest19388-21apt-get10:05:180
594099171,11cyclictest1602-21apt-esm-hook09:25:160
5940991710,5cyclictest19128-21unixbench-2d11:15:260
5940991710,5cyclictest17861-21entropy07:35:140
5940991710,5cyclictest17162-21grep12:25:190
595499169,5cyclictest13729-21expr11:05:153
5954991612,2cyclictest22492-21entropy11:25:163
5949991613,2cyclictest15321-21fschecks_time09:55:182
594099169,5cyclictest18963-21apt-get12:30:160
594099161,12cyclictest9186-21snmp_o5powerctl09:40:260
5940991610,4cyclictest5468-21expr08:20:160
5940991610,4cyclictest10436-21dpkg09:45:010
5940991511,2cyclictest24195-21sh07:50:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional