You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-31 - 13:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Wed Dec 31, 2025 00:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
117350299796,29cyclictest0-21swapper/221:50:012
117349999747,63cyclictest0-21swapper/120:10:011
1173497997062,5cyclictest131ktimers/000:25:000
117349799691,3cyclictest0-21swapper/021:30:010
1173499996837,25cyclictest1182292-21sendmail19:59:591
1173497996828,36cyclictest0-21swapper/019:59:590
1173499996326,29cyclictest0-21swapper/119:10:281
1173499996032,23cyclictest0-21swapper/123:35:301
117349999602,50cyclictest1185969-21apt-get20:20:161
1173499995932,22cyclictest0-21swapper/121:15:291
1173499995925,29cyclictest1212938-21grep22:55:291
1173499995925,29cyclictest1212938-21grep22:55:291
1173499995824,29cyclictest1197357-21tail21:25:271
1173499995818,33cyclictest0-21swapper/121:25:021
1173497995846,9cyclictest1206124-21sendmail22:19:590
117350299566,44cyclictest30-21rcuc/220:10:022
117349999567,36cyclictest1178257-21/usr/sbin/munin19:35:191
117349999567,36cyclictest1178257-21/usr/sbin/munin19:35:181
1173499995628,23cyclictest0-21swapper/123:55:301
117349999553,36cyclictest1660-21snmpd21:45:131
1173499995528,21cyclictest0-21swapper/119:40:301
117349999552,45cyclictest1220957-21apt-get23:45:161
117349999552,43cyclictest1214695-21grep23:05:301
117349999552,43cyclictest0-21swapper/122:15:011
1173499995522,28cyclictest0-21swapper/123:30:161
117349999551,8cyclictest1192167-21/usr/sbin/munin20:55:261
117349999543,43cyclictest1210187-21memory22:40:271
117349999543,43cyclictest0-21swapper/121:55:201
117349999543,41cyclictest1660-21snmpd20:15:271
117349999542,9cyclictest1201756-21grep21:50:281
117349999542,44cyclictest1186957-21sh20:25:211
117349999542,42cyclictest1199170-21tail21:35:281
117349999541,41cyclictest1206566-21lsblk22:20:201
1173497995446,6cyclictest0-21swapper/022:35:010
117349999536,37cyclictest0-21swapper/123:50:171
1173499995343,6cyclictest1177132-21munin-plugin-st19:30:011
117349999533,38cyclictest1200015-21grep21:40:281
1173499995326,21cyclictest0-21swapper/100:10:271
117349999532,41cyclictest1191552-21grep20:50:291
117349999532,41cyclictest1191552-21grep20:50:291
117349999532,39cyclictest1230044-21cron00:40:001
117349999531,46cyclictest1194192-21sshd21:07:301
117349999531,46cyclictest1194192-21sshd21:07:301
117349999531,44cyclictest1228308-21grep00:25:311
1173502995241,7cyclictest1177855-21unixbench_multi19:30:292
1173502995241,7cyclictest1177855-21unixbench_multi19:30:292
117349999522,42cyclictest1208785-21unixbench_singl22:30:291
117349999522,39cyclictest1180530-21unixbench_singl19:45:291
1173499995216,29cyclictest1660-21snmpd20:30:311
117349999521,10cyclictest1226012-21/usr/sbin/munin00:15:331
1173502995138,9cyclictest0-21swapper/222:10:012
1173499995138,7cyclictest1181441-21munin-plugin-st19:55:001
1173499995138,7cyclictest1181441-21munin-plugin-st19:55:001
117349999513,40cyclictest1224861-21grep00:05:301
117349999513,40cyclictest1197786-21apt-get21:30:171
117349999512,42cyclictest1212122-21unixbench_multi22:50:291
117349999512,39cyclictest1190305-21fschecks_count20:45:221
117349999511,43cyclictest0-21swapper/123:20:261
117349799513,21cyclictest1183987-21apt-key20:10:010
117349999506,35cyclictest0-21swapper/100:30:321
117349999503,8cyclictest1214948-21apt-get23:10:121
117349999503,37cyclictest0-21swapper/100:00:211
117349999502,39cyclictest0-21swapper/120:05:001
117349999502,37cyclictest1175648-21/usr/sbin/munin19:20:201
117349999502,14cyclictest1207262-21apt-get22:25:161
117349999501,8cyclictest1204119-21/usr/sbin/munin22:05:291
117349999501,40cyclictest1220476-21sendmail_mailqu23:40:271
1173497995011,25cyclictest1207259-21/usr/sbin/munin22:25:200
117349999496,36cyclictest1213318-21/usr/sbin/munin23:00:161
117349999493,40cyclictest0-21swapper/121:15:011
117349999492,39cyclictest1215926-21grep23:15:201
1173499994918,23cyclictest0-21swapper/122:45:291
1173499994917,24cyclictest0-21swapper/100:25:001
1173499994917,23cyclictest0-21swapper/119:30:281
1173499994917,23cyclictest0-21swapper/119:30:281
1173497994927,12cyclictest1216439-21sendmail23:19:590
117350299484,26cyclictest311ktimers/223:40:002
1173502994840,4cyclictest1214696-21unixbench_singl23:05:312
1173502994832,8cyclictest1199274-21sendmail21:40:002
1173502994829,10cyclictest0-21swapper/221:40:192
117350299482,13cyclictest1205179-21apt-get22:15:012
117349999483,4cyclictest1184267-21apt-get20:10:151
117349999482,5cyclictest1205469-21/usr/sbin/munin22:15:311
117349999481,8cyclictest1217552-21/usr/sbin/munin23:25:181
117349999481,8cyclictest1188689-21fw_packets20:35:231
117349999481,8cyclictest1188689-21fw_packets20:35:221
1173499994812,29cyclictest0-21swapper/119:10:011
1173499994811,29cyclictest0-21swapper/120:40:181
117349799485,3cyclictest0-21swapper/019:45:010
1173497994839,6cyclictest20850irq/208-8000000.ethernet21:55:220
117349799481,40cyclictest1180776-21latency_hist19:50:020
1173502994726,15cyclictest0-21swapper/200:15:012
117349999472,37cyclictest0-21swapper/122:00:211
117349999472,35cyclictest1209214-21tune2fs22:35:201
117349999471,5cyclictest1174786-21/usr/sbin/munin19:15:101
1173497994738,5cyclictest0-21swapper/020:05:000
1173497994727,18cyclictest0-21swapper/021:15:290
1173502994638,4cyclictest1197586-21munin-plugin-st21:29:592
117349999464,36cyclictest1193491-21latency_hist21:05:011
1173502994538,5cyclictest311ktimers/223:50:012
1173502994535,6cyclictest1194154-21grep21:05:292
1173502994535,6cyclictest1194154-21grep21:05:292
1173502994534,6cyclictest0-21swapper/219:15:282
1173502994511,13cyclictest30-21rcuc/220:55:022
1173502994511,13cyclictest30-21rcuc/220:55:012
1173497994539,4cyclictest0-21swapper/021:30:230
1173497994539,3cyclictest20650irq/252-8000000.ethernet22:10:000
1173497994538,3cyclictest1229357-21latency_hist00:35:020
117349799451,41cyclictest1212574-21ssh22:55:220
117349799451,41cyclictest1212574-21ssh22:55:220
1173502994435,5cyclictest1195881-21cron21:20:002
1173497994437,5cyclictest0-21swapper/023:25:300
117349799442,3cyclictest0-21swapper/000:00:000
117349799442,39cyclictest1199152-21tail21:35:290
117349799441,41cyclictest0-21swapper/000:15:130
1173502994331,7cyclictest0-21swapper/219:10:302
1173502994326,12cyclictest311ktimers/222:20:132
117349799435,36cyclictest131ktimers/022:20:040
1173497994337,4cyclictest20850irq/208-8000000.ethernet21:00:000
1173497994336,4cyclictest167350irq/118-8000000.ethernet-tx023:50:170
1173497994336,4cyclictest167350irq/118-8000000.ethernet-tx022:55:010
1173497994335,5cyclictest0-21swapper/022:00:290
1173502994229,8cyclictest0-21swapper/223:25:282
117349799426,4cyclictest0-21swapper/023:05:000
117349799423,5cyclictest0-21swapper/022:15:000
1173497994234,5cyclictest20850irq/208-8000000.ethernet20:35:290
1173497994234,5cyclictest20850irq/208-8000000.ethernet20:35:290
1173497994224,15cyclictest1219964-21latency_hist23:40:010
117349799421,4cyclictest0-21swapper/021:50:010
117349799421,39cyclictest0-21swapper/021:05:210
117349799421,39cyclictest0-21swapper/021:05:210
117349799421,39cyclictest0-21swapper/000:10:230
1173502994130,7cyclictest0-21swapper/221:50:282
117350299412,10cyclictest1191867-21/usr/sbin/munin20:55:302
117349799413,8cyclictest1177979-21gpgv19:35:010
117349799413,8cyclictest1177979-21gpgv19:35:010
1173497994135,4cyclictest0-21swapper/020:20:230
1173497994128,9cyclictest0-21swapper/023:20:270
1173497994122,10cyclictest0-21swapper/020:40:300
117349799410,39cyclictest0-21swapper/000:25:140
1173502994031,5cyclictest0-21swapper/200:35:292
1173502994030,5cyclictest0-21swapper/222:55:302
1173502994030,5cyclictest0-21swapper/222:55:292
1173502994028,8cyclictest0-21swapper/222:00:302
1173502994028,8cyclictest0-21swapper/221:10:292
1173502994028,6cyclictest0-21swapper/222:45:292
1173502994021,9cyclictest0-21swapper/219:25:272
1173497994031,5cyclictest19750irq/27-20000000.i2c21:00:170
1173497994029,8cyclictest0-21swapper/022:35:280
117349799401,4cyclictest1191669-21munin-run20:55:000
117349799401,4cyclictest1191669-21munin-run20:55:000
117349799401,37cyclictest0-21swapper/021:10:250
117349799401,37cyclictest0-21swapper/019:50:280
117349799401,37cyclictest0-21swapper/019:50:270
117349799401,35cyclictest131ktimers/021:40:280
1173502993930,4cyclictest0-21swapper/219:50:292
1173502993930,4cyclictest0-21swapper/219:50:292
1173502993929,6cyclictest0-21swapper/200:15:322
1173502993921,9cyclictest1190588-21awk20:45:292
1173497993933,4cyclictest0-21swapper/022:40:280
1173497993929,6cyclictest131ktimers/023:30:290
117349799391,36cyclictest1184775-21/usr/sbin/munin20:10:280
117349799391,36cyclictest0-21swapper/019:15:100
1173502993818,9cyclictest0-21swapper/223:10:292
1173497993832,3cyclictest1214162-21ssh23:05:180
1173497993829,6cyclictest20850irq/208-8000000.ethernet00:40:000
1173497993828,6cyclictest1220550-21grep23:40:290
1173497993825,9cyclictest1187450-21munin-plugin-st20:29:590
117349799381,4cyclictest0-21swapper/023:15:010
117349799381,35cyclictest0-21swapper/021:50:190
117349799381,35cyclictest0-21swapper/019:35:190
117349799381,35cyclictest0-21swapper/019:35:180
117349799381,35cyclictest0-21swapper/019:10:140
1173502993727,4cyclictest0-21swapper/221:25:002
1173502993727,4cyclictest0-21swapper/219:35:212
1173502993727,4cyclictest0-21swapper/219:35:212
1173502993722,8cyclictest0-21swapper/219:20:302
1173502993721,7cyclictest30-21rcuc/200:00:302
117349799371,34cyclictest0-21swapper/023:45:160
1173502993627,5cyclictest0-21swapper/219:44:592
1173502993626,6cyclictest0-21swapper/220:30:302
1173502993622,8cyclictest0-21swapper/222:54:592
1173502993622,5cyclictest0-21swapper/200:25:292
1173502993621,10cyclictest0-21swapper/222:15:262
1173497993630,4cyclictest0-21swapper/022:45:160
1173497993630,4cyclictest0-21swapper/020:45:210
1173497993630,4cyclictest0-21swapper/019:25:200
1173497993629,4cyclictest0-21swapper/021:20:290
117349799361,2cyclictest0-21swapper/020:35:000
1173502993525,5cyclictest0-21swapper/223:40:282
1173502993520,8cyclictest0-21swapper/220:35:282
1173502993520,8cyclictest0-21swapper/220:35:282
1173502993519,8cyclictest0-21swapper/223:30:282
1173502993517,12cyclictest311ktimers/220:25:122
1173502993514,7cyclictest1192725-21/usr/sbin/munin21:00:202
117350299351,12cyclictest1183976-21apt-get20:10:022
117349799351,3cyclictest0-21swapper/020:16:230
1173502993424,5cyclictest167550irq/134-8000000.ethernet-tx219:55:232
1173497993427,4cyclictest20850irq/208-8000000.ethernet00:00:210
117349799341,3cyclictest0-21swapper/019:22:250
1173502993323,5cyclictest0-21swapper/222:35:272
1173502993315,10cyclictest311ktimers/223:15:132
1173502993225,3cyclictest0-21swapper/220:00:292
1173502993221,6cyclictest0-21swapper/219:10:012
117350299321,24cyclictest0-21swapper/222:40:182
117350299321,24cyclictest0-21swapper/222:30:172
1173502993123,5cyclictest0-21swapper/219:45:292
1173502993119,8cyclictest0-21swapper/221:55:302
117350299311,24cyclictest0-21swapper/220:15:192
1173502993111,5cyclictest8321systemd-network23:54:472
1173497993125,4cyclictest20850irq/208-8000000.ethernet00:05:140
117350299309,6cyclictest8321systemd-network00:22:132
1173502993023,4cyclictest30-21rcuc/200:30:302
1173502993022,5cyclictest0-21swapper/223:25:012
1173502993022,4cyclictest2-21kthreadd20:21:192
1173502993022,4cyclictest14-21rcu_preempt00:05:292
1173502993020,5cyclictest30-21rcuc/220:40:292
1173502992921,5cyclictest1223269-21sshd23:59:292
1173502992915,9cyclictest0-21swapper/222:25:202
1173502992915,10cyclictest0-21swapper/221:30:302
1173502992717,7cyclictest0-21swapper/223:00:292
1173497992316,3cyclictest20650irq/252-8000000.ethernet19:10:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional