You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-16 - 17:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #4, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot1s.osadl.org (updated Tue Apr 16, 2024 12:43:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2048521250,2chrt20483-21tail07:42:591
2048521250,2chrt20483-21tail07:42:591
1446021020,3chrt0-21swapper/108:52:571
1446021020,3chrt0-21swapper/108:52:571
118782760,2chrt11882-21head10:12:470
118782760,2chrt11882-21head10:12:470
273912730,3chrt0-21swapper/009:27:570
273912730,3chrt0-21swapper/009:27:570
325022700,2chrt0-21swapper/009:42:320
325022700,2chrt0-21swapper/009:42:320
115082680,5sleep011509-21ls07:22:280
7962995647,6cyclictest36350irq/47-eth011:57:390
7962995647,6cyclictest36350irq/47-eth011:57:390
51932560,3sleep20-21swapper/211:22:282
51932560,3sleep20-21swapper/211:22:282
237432520,3sleep00-21swapper/009:17:560
237432520,3sleep00-21swapper/009:17:560
7962995120,10cyclictest0-21swapper/007:44:350
7962995120,10cyclictest0-21swapper/007:44:350
7962995034,11cyclictest9661-21apt-get10:07:390
7962995028,20cyclictest0-21swapper/010:27:380
7962995028,20cyclictest0-21swapper/010:27:380
7962995028,20cyclictest0-21swapper/010:27:380
796299493,37cyclictest799-21runrttasks11:17:380
796299493,37cyclictest799-21runrttasks11:17:380
7962994919,19cyclictest0-21swapper/007:12:370
7962994919,19cyclictest0-21swapper/007:12:370
7962994917,24cyclictest0-21swapper/011:47:410
7962994917,24cyclictest0-21swapper/011:47:410
73562492,10sleep00-21swapper/007:08:120
73562492,10sleep00-21swapper/007:08:120
7962994819,26cyclictest0-21swapper/012:17:380
7962994819,26cyclictest0-21swapper/012:17:380
7962994816,23cyclictest0-21swapper/011:52:420
7962994816,23cyclictest0-21swapper/011:52:420
7962994815,15cyclictest11745-21/usr/sbin/munin07:22:390
7962994815,15cyclictest11745-21/usr/sbin/munin07:22:390
197822480,2chrt0-21swapper/010:32:490
173752480,4sleep00-21swapper/007:37:390
173752480,4sleep00-21swapper/007:37:390
796399478,4cyclictest281ktimers/108:07:411
796399478,4cyclictest281ktimers/108:07:411
796299473,39cyclictest24719-21chrt10:47:360
796299473,39cyclictest24719-21chrt10:47:360
7962994722,4cyclictest28193-21apt-get12:22:380
7962994722,4cyclictest28193-21apt-get12:22:380
7962994619,16cyclictest26506-21seq08:00:420
7962994619,16cyclictest26506-21seq08:00:420
7962994618,10cyclictest3818-21wc08:27:300
7962994618,10cyclictest3818-21wc08:27:300
65192460,2chrt6518-21sed08:32:460
270812460,2sleep016-21ksoftirqd/008:02:480
270812460,2sleep016-21ksoftirqd/008:02:480
7962994531,11cyclictest28648-21apt-get09:32:410
7962994531,11cyclictest28648-21apt-get09:32:410
7962994525,18cyclictest0-21swapper/011:12:420
7962994525,18cyclictest0-21swapper/011:12:420
7962994517,10cyclictest26474-21taskset09:26:470
7962994517,10cyclictest26474-21taskset09:26:470
7962994425,13cyclictest13584-21apt-get08:52:390
7962994425,13cyclictest13584-21apt-get08:52:390
7962994417,19cyclictest0-21swapper/009:47:400
7962994417,19cyclictest0-21swapper/009:47:400
7962994416,9cyclictest7917-21df08:37:460
7962994330,7cyclictest3964-21apt-get09:52:410
7962994330,7cyclictest3964-21apt-get09:52:410
7962994317,8cyclictest15384-21sed07:32:320
7962994317,8cyclictest15384-21sed07:32:320
7962994317,7cyclictest0-21swapper/009:44:570
7962994317,7cyclictest0-21swapper/009:44:570
7962994315,11cyclictest14893-21taskset10:20:240
7962994315,11cyclictest14893-21taskset10:20:240
796299431,39cyclictest5872-21cut08:32:360
7962994313,23cyclictest171ktimers/011:07:400
7962994313,23cyclictest171ktimers/011:07:400
7962994222,17cyclictest0-21swapper/010:37:410
7962994222,17cyclictest0-21swapper/010:37:410
7962994217,8cyclictest10378-21expr08:42:580
7962994217,8cyclictest10378-21expr08:42:580
314452420,3sleep30-21swapper/308:13:003
314452420,3sleep30-21swapper/308:13:003
7962994132,6cyclictest5840-21apt-get09:57:420
7962994132,6cyclictest5840-21apt-get09:57:420
7962994126,10cyclictest21122-21apt-get09:12:390
7962994126,10cyclictest21122-21apt-get09:12:390
7962994119,12cyclictest16799-21chrt10:25:300
7962994116,8cyclictest22342-21sed07:48:000
7962994116,8cyclictest0-21swapper/011:41:460
7962994116,8cyclictest0-21swapper/011:41:460
7962994116,15cyclictest31938-21taskset08:13:080
7962994116,15cyclictest31938-21taskset08:13:080
7962994116,10cyclictest4426-21if_eth008:27:470
7962994115,9cyclictest26690-21df_inode10:52:430
7962994115,9cyclictest26690-21df_inode10:52:430
7962994115,8cyclictest24521-21df12:12:400
7962994115,8cyclictest24521-21df12:12:400
7962994115,11cyclictest21410-21uname12:02:510
7962994115,11cyclictest21410-21uname12:02:510
7962994115,10cyclictest30036-21taskset11:01:480
7962994115,10cyclictest30036-21taskset11:01:480
7962994114,8cyclictest8724-21taskset11:28:410
69472410,4sleep30-21swapper/309:58:033
69472410,4sleep30-21swapper/309:58:033
7962994025,10cyclictest0-21swapper/010:42:390
7962994025,10cyclictest0-21swapper/010:42:390
7962994018,12cyclictest2889-21seq12:39:280
7962994018,12cyclictest2889-21seq12:39:280
7962994017,10cyclictest9117-21taskset10:03:310
7962994017,10cyclictest9117-21taskset10:03:310
7962994017,10cyclictest31811-21chrt11:05:170
7962994017,10cyclictest24312-21latency_hist12:12:330
7962994017,10cyclictest24312-21latency_hist12:12:330
7962994016,7cyclictest18888-21taskset09:06:170
7962994016,7cyclictest18888-21taskset09:06:170
7962994016,10cyclictest12177-21taskset08:47:480
7962994016,10cyclictest12177-21taskset08:47:480
7962994015,7cyclictest30628-21latency_hist08:12:350
326542400,2sleep30-21swapper/308:17:383
326542400,2sleep30-21swapper/308:17:383
796399399,15cyclictest281ktimers/108:57:421
796399394,4cyclictest281ktimers/110:32:381
796399392,4cyclictest281ktimers/107:22:401
796399392,4cyclictest281ktimers/107:22:401
7962993919,6cyclictest1812-21taskset08:21:530
7962993919,6cyclictest1812-21taskset08:21:530
7962993915,11cyclictest15887-21cat08:57:510
7962993915,10cyclictest16839-21taskset07:33:410
7962993915,10cyclictest16839-21taskset07:33:410
7963993827,9cyclictest8147-21fschecks_count07:12:411
7963993827,9cyclictest8147-21fschecks_count07:12:411
7962993817,9cyclictest5721-21fschecks_time11:22:450
7962993817,9cyclictest5721-21fschecks_time11:22:450
7962993817,4cyclictest14671-21apt-get11:47:350
7962993817,4cyclictest14671-21apt-get11:47:350
7962993813,11cyclictest856-21awk12:32:560
7962993813,11cyclictest856-21awk12:32:560
7962993812,12cyclictest19232-21runrttasks09:07:390
7962993812,12cyclictest19232-21runrttasks09:07:390
7962993722,11cyclictest171ktimers/011:32:390
7962993722,11cyclictest171ktimers/011:32:390
7962993716,4cyclictest28791-21apt-get08:07:410
7962993713,7cyclictest0-21swapper/012:29:340
7962993713,7cyclictest0-21swapper/012:29:340
67642374,25sleep16860-21gzip07:07:521
67642374,25sleep16860-21gzip07:07:521
7963993628,5cyclictest0-21swapper/111:02:391
7962993615,9cyclictest24691-21runrttasks07:56:240
7963993326,5cyclictest693-21avahi-daemon12:02:531
7963993326,5cyclictest693-21avahi-daemon12:02:531
7963993323,8cyclictest16835-21latency_hist11:52:351
7963993323,8cyclictest16835-21latency_hist11:52:351
7963993318,4cyclictest91-1pr/ttyS007:32:561
7963993318,4cyclictest91-1pr/ttyS007:32:561
7963993317,3cyclictest91-1pr/ttyS008:27:581
7963993317,3cyclictest91-1pr/ttyS008:27:581
796399322,5cyclictest281ktimers/109:32:391
796399322,5cyclictest281ktimers/109:32:391
7963993224,6cyclictest5790-21head11:22:461
7963993224,6cyclictest5790-21head11:22:461
7963993218,4cyclictest91-1pr/ttyS010:22:461
7963993215,3cyclictest91-1pr/ttyS010:57:401
7963993215,3cyclictest91-1pr/ttyS010:57:401
7963993215,3cyclictest91-1pr/ttyS008:13:011
7963993215,3cyclictest91-1pr/ttyS008:13:011
7963993212,2cyclictest0-21swapper/110:47:471
7963993212,2cyclictest0-21swapper/110:47:471
796599312,22cyclictest7386-21taskset11:27:393
796599311,22cyclictest7989-21taskset07:12:383
796599311,22cyclictest7989-21taskset07:12:383
796499312,22cyclictest17387-21taskset07:37:412
796499312,22cyclictest17387-21taskset07:37:412
7963993123,6cyclictest19096-21gltestperf11:57:431
7963993123,6cyclictest19096-21gltestperf11:57:431
7963993117,11cyclictest281ktimers/110:40:551
7963993117,11cyclictest281ktimers/110:40:551
7963993115,3cyclictest91-1pr/ttyS009:28:031
7963993115,3cyclictest91-1pr/ttyS009:28:031
7963993114,5cyclictest91-1pr/ttyS009:07:481
7963993114,5cyclictest91-1pr/ttyS009:07:481
291662310,2sleep30-21swapper/309:32:523
291662310,2sleep30-21swapper/309:32:523
796399305,19cyclictest667-21munin-node12:41:011
796399305,19cyclictest667-21munin-node12:41:011
7963993023,4cyclictest15765-21snmpd08:17:581
7963993023,4cyclictest15765-21snmpd08:17:581
7963993022,6cyclictest26648-21cron08:02:271
7963993022,6cyclictest26648-21cron08:02:271
796399302,23cyclictest17387-21taskset07:37:411
796399302,23cyclictest17387-21taskset07:37:411
7963993019,2cyclictest181rcu_preempt11:32:451
7963993019,2cyclictest181rcu_preempt11:32:451
7963993017,4cyclictest181rcu_preempt10:15:041
7963993017,4cyclictest181rcu_preempt10:15:041
796399301,14cyclictest271rcuc/110:00:011
796399301,14cyclictest271rcuc/110:00:011
7963993011,3cyclictest0-21swapper/108:47:411
7963993011,3cyclictest0-21swapper/108:47:411
75792306,16sleep30-21swapper/307:11:013
75792306,16sleep30-21swapper/307:11:013
7963992922,4cyclictest281ktimers/111:12:551
7963992922,4cyclictest281ktimers/111:12:551
796399292,18cyclictest799-21runrttasks11:27:391
7963992921,6cyclictest26723-21latency_hist09:27:351
7963992921,6cyclictest26723-21latency_hist09:27:351
7963992921,6cyclictest11402-21fschecks_time11:37:441
7963992921,6cyclictest11402-21fschecks_time11:37:441
7963992916,4cyclictest91-1pr/ttyS007:47:421
7963992911,5cyclictest91-1pr/ttyS012:37:321
7963992911,5cyclictest91-1pr/ttyS012:37:321
796399289,3cyclictest0-21swapper/110:42:441
796399289,3cyclictest0-21swapper/110:42:441
796399289,3cyclictest0-21swapper/110:07:441
796399284,4cyclictest281ktimers/112:08:271
796399284,4cyclictest281ktimers/112:08:271
7963992822,4cyclictest91-1pr/ttyS012:24:231
7963992822,4cyclictest91-1pr/ttyS012:24:231
7963992821,5cyclictest23346-21fschecks_time07:52:441
7963992821,5cyclictest136-21systemd-journal07:32:271
7963992821,5cyclictest136-21systemd-journal07:32:271
7963992813,3cyclictest91-1pr/ttyS008:32:401
73592285,16sleep20-21swapper/207:08:142
73592285,16sleep20-21swapper/207:08:142
796399271,5cyclictest281ktimers/110:56:401
796399271,5cyclictest281ktimers/110:56:401
7963992714,4cyclictest91-1pr/ttyS009:37:391
7963992714,4cyclictest91-1pr/ttyS009:37:391
7963992714,4cyclictest60-21kcompactd009:18:011
7963992714,4cyclictest60-21kcompactd009:18:011
7963992712,7cyclictest21806-21lldpd11:46:411
7963992712,7cyclictest21806-21lldpd11:46:411
7963992712,4cyclictest181rcu_preempt09:45:361
7963992712,4cyclictest181rcu_preempt09:45:361
251942270,4sleep30-21swapper/310:47:443
251942270,4sleep30-21swapper/310:47:443
796399268,3cyclictest0-21swapper/109:02:401
796399268,3cyclictest0-21swapper/109:02:401
796399265,3cyclictest281ktimers/110:21:391
796399265,3cyclictest281ktimers/110:21:391
7963992622,2cyclictest0-21swapper/109:47:371
7963992622,2cyclictest0-21swapper/109:47:371
796399262,20cyclictest7818-21apt-get08:37:431
7963992621,3cyclictest0-21swapper/107:17:491
7963992619,6cyclictest30533-21gltestperf12:27:431
7963992619,6cyclictest30533-21gltestperf12:27:431
7963992618,2cyclictest181rcu_preempt12:17:511
7963992618,2cyclictest181rcu_preempt12:17:511
796399261,6cyclictest271rcuc/108:45:061
796399261,6cyclictest271rcuc/108:45:061
796499253,15cyclictest22848-21chrt10:42:402
796499253,15cyclictest22848-21chrt10:42:402
796399254,10cyclictest26921-21apt-get08:02:431
796399254,10cyclictest26921-21apt-get08:02:431
7963992521,2cyclictest0-21swapper/110:03:031
7963992521,2cyclictest0-21swapper/110:03:031
7963992520,3cyclictest281ktimers/111:17:561
7963992520,3cyclictest281ktimers/111:17:561
7963992517,2cyclictest181rcu_preempt09:12:421
7963992517,2cyclictest181rcu_preempt09:12:421
7963992516,2cyclictest181rcu_preempt11:57:341
7963992516,2cyclictest181rcu_preempt11:57:341
796399245,5cyclictest271rcuc/110:33:481
7963992418,4cyclictest7961-21cyclictest11:07:511
7963992418,4cyclictest7961-21cyclictest11:07:511
7963992416,2cyclictest181rcu_preempt12:12:531
7963992416,2cyclictest181rcu_preempt12:12:531
796599233,15cyclictest187782sleep311:57:393
796599233,15cyclictest187782sleep311:57:393
7963992316,5cyclictest0-21swapper/108:22:511
7963992316,5cyclictest0-21swapper/108:22:511
7963992310,3cyclictest91-1pr/ttyS010:31:451
7963992310,3cyclictest91-1pr/ttyS010:31:451
173242230,3sleep30-21swapper/310:27:423
173242230,3sleep30-21swapper/310:27:423
173242230,3sleep30-21swapper/310:27:423
796499223,9cyclictest0-21swapper/210:02:422
796499223,9cyclictest0-21swapper/210:02:422
796499223,12cyclictest0-21swapper/212:27:372
796499223,12cyclictest0-21swapper/212:27:372
7963992216,4cyclictest0-21swapper/109:52:461
7963992216,4cyclictest0-21swapper/109:52:461
796599213,9cyclictest0-21swapper/312:27:373
796599213,9cyclictest0-21swapper/312:27:373
796499213,9cyclictest0-21swapper/208:07:422
796499213,9cyclictest0-21swapper/208:07:422
796499213,11cyclictest0-21swapper/209:32:412
796499213,11cyclictest0-21swapper/209:32:412
796499213,10cyclictest0-21swapper/210:47:382
796499213,10cyclictest0-21swapper/210:47:382
796499212,9cyclictest0-21swapper/209:57:422
796499212,9cyclictest0-21swapper/209:57:422
796499212,10cyclictest0-21swapper/211:57:392
796499212,10cyclictest0-21swapper/211:57:392
154442210,3sleep20-21swapper/207:32:342
154442210,3sleep20-21swapper/207:32:342
796599203,9cyclictest0-21swapper/310:52:413
796599203,9cyclictest0-21swapper/310:52:413
796499203,9cyclictest0-21swapper/212:12:382
796499203,9cyclictest0-21swapper/212:12:382
796499203,9cyclictest0-21swapper/211:47:402
796499203,9cyclictest0-21swapper/211:47:402
796499203,9cyclictest0-21swapper/210:37:432
796499203,9cyclictest0-21swapper/210:37:432
796499203,9cyclictest0-21swapper/210:27:402
796499203,9cyclictest0-21swapper/210:27:402
796499203,9cyclictest0-21swapper/210:27:402
796499203,9cyclictest0-21swapper/209:17:412
796499203,9cyclictest0-21swapper/209:17:412
796499203,9cyclictest0-21swapper/208:47:402
796499203,9cyclictest0-21swapper/208:47:402
796499203,9cyclictest0-21swapper/208:42:422
796499203,9cyclictest0-21swapper/208:42:422
796499203,9cyclictest0-21swapper/207:52:412
796499203,11cyclictest0-21swapper/208:52:442
796499203,11cyclictest0-21swapper/208:52:442
796499202,9cyclictest0-21swapper/211:42:422
796499202,9cyclictest0-21swapper/211:42:422
796499202,9cyclictest0-21swapper/209:42:362
796499202,9cyclictest0-21swapper/209:27:422
796499202,9cyclictest0-21swapper/209:27:422
132982201,2sleep30-21swapper/307:26:213
132982201,2sleep30-21swapper/307:26:213
796599193,9cyclictest0-21swapper/310:42:413
796599193,9cyclictest0-21swapper/310:42:413
796599192,9cyclictest0-21swapper/309:02:423
796599192,9cyclictest0-21swapper/309:02:423
796499193,9cyclictest0-21swapper/212:07:402
796499193,9cyclictest0-21swapper/212:07:402
796499193,9cyclictest0-21swapper/211:52:432
796499193,9cyclictest0-21swapper/211:52:432
796499193,9cyclictest0-21swapper/210:52:412
796499193,9cyclictest0-21swapper/210:52:412
796499193,9cyclictest0-21swapper/208:17:362
796499193,8cyclictest0-21swapper/212:27:402
796499193,8cyclictest0-21swapper/212:27:402
796499193,10cyclictest0-21swapper/211:32:412
796499193,10cyclictest0-21swapper/211:32:412
796499192,9cyclictest0-21swapper/210:17:442
796499192,9cyclictest0-21swapper/210:17:442
796499192,9cyclictest0-21swapper/207:42:422
796499192,9cyclictest0-21swapper/207:42:422
796499192,6cyclictest0-21swapper/212:37:392
796499192,6cyclictest0-21swapper/212:37:392
796499192,10cyclictest0-21swapper/212:32:392
796499192,10cyclictest0-21swapper/212:32:392
796499192,10cyclictest0-21swapper/209:02:422
796499192,10cyclictest0-21swapper/209:02:422
796499191,13cyclictest15878-21chrt10:22:462
796599181,12cyclictest5456-21chrt11:22:413
796599181,12cyclictest5456-21chrt11:22:413
796499183,9cyclictest0-21swapper/211:22:422
796499183,9cyclictest0-21swapper/211:22:422
796499182,9cyclictest0-21swapper/209:37:412
796499182,8cyclictest0-21swapper/211:37:422
796499182,8cyclictest0-21swapper/211:37:422
796499182,8cyclictest0-21swapper/209:07:402
796499182,8cyclictest0-21swapper/209:07:402
796499181,12cyclictest21126-21taskset09:12:402
796499181,12cyclictest21126-21taskset09:12:402
796599177,6cyclictest0-21swapper/311:17:383
796599177,6cyclictest0-21swapper/311:17:383
796599173,9cyclictest0-21swapper/309:42:363
796599173,9cyclictest0-21swapper/309:27:423
796599173,9cyclictest0-21swapper/309:27:423
796599173,9cyclictest0-21swapper/309:17:413
796599173,9cyclictest0-21swapper/309:17:413
796599172,9cyclictest153292sleep310:22:403
796599172,9cyclictest0-21swapper/307:52:363
796599172,10cyclictest0-21swapper/310:02:423
796599172,10cyclictest0-21swapper/310:02:423
796599171,11cyclictest26715-21taskset12:17:443
796599171,11cyclictest26715-21taskset12:17:443
796599171,10cyclictest11683-21chrt08:47:363
796499173,9cyclictest0-21swapper/210:12:432
796499173,9cyclictest0-21swapper/210:12:432
796499173,9cyclictest0-21swapper/209:22:442
796499173,9cyclictest0-21swapper/209:22:442
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional