You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-20 - 15:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot5s.osadl.org (updated Sat Apr 20, 2024 00:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
982152998171,5cyclictest987705-21kworker/u8:2+events_unbound19:31:422
982152997265,5cyclictest1091059-21kworker/u8:0+events_unbound00:33:492
982152997164,5cyclictest1035937-21kworker/u8:2+events_unbound22:47:172
982153996956,5cyclictest992815-21kworker/u8:3+events_unbound19:56:453
982152996963,4cyclictest1023761-21kworker/u8:0+events_unbound21:17:002
982152996654,6cyclictest1013605-21kworker/u8:1+events_unbound21:27:022
982153996559,4cyclictest1040026-21kworker/u8:1+events_unbound21:57:083
982153996559,4cyclictest1040026-21kworker/u8:1+events_unbound21:57:083
982152996559,4cyclictest1035937-21kworker/u8:2+events_unbound22:27:132
982152996458,4cyclictest1001637-21kworker/u8:0+events_unbound20:16:502
982152996357,4cyclictest1015495-21kworker/u8:2+events_unbound20:46:552
982153996247,6cyclictest1049892-21kworker/u8:3+events_unbound22:35:173
982153995944,6cyclictest1075675-21kworker/u8:1+events_unbound23:55:183
982152995952,5cyclictest1058492-21kworker/u8:3+events_unbound22:52:182
982153995845,7cyclictest1006859-21kworker/u8:2+events_unbound20:21:523
982152995852,4cyclictest992815-21kworker/u8:3+events_unbound19:41:432
982152995549,4cyclictest1082504-21kworker/u8:2+events_unbound00:03:132
982151995548,4cyclictest1029088-21kworker/u8:0+events_unbound21:25:221
982153995448,4cyclictest1015495-21kworker/u8:2+events_unbound21:22:033
982152995448,4cyclictest963902-21kworker/u8:0+events_unbound19:11:402
982152995443,5cyclictest1065171-21kworker/u8:0+events_unbound23:07:232
982151995448,4cyclictest1001637-21kworker/u8:0+events_unbound20:31:541
982151995447,5cyclictest1060222-21kworker/u8:2+events_unbound23:27:261
982153995345,6cyclictest1015495-21kworker/u8:2+events_unbound21:10:233
982151995346,5cyclictest1001637-21kworker/u8:0+events_unbound20:11:481
982153995245,5cyclictest1048151-21kworker/u8:1+events_unbound22:22:123
982153995245,4cyclictest1039663-21idleruntime-cro21:55:013
982152995241,5cyclictest1049892-21kworker/u8:3+events_unbound22:30:232
982151995246,4cyclictest1048151-21kworker/u8:1+events_unbound22:22:131
982152995145,4cyclictest1044941-21kworker/u8:0+events_unbound22:17:122
982152995143,6cyclictest1040026-21kworker/u8:1+events_unbound22:07:522
982151995145,4cyclictest1015495-21kworker/u8:2+events_unbound20:56:571
982151995144,5cyclictest1058492-21kworker/u8:3+events_unbound22:50:211
982151995135,6cyclictest1015495-21kworker/u8:2+events_unbound21:10:211
982153995042,6cyclictest992815-21kworker/u8:3+events_unbound19:38:523
982153995037,7cyclictest1062870-21kworker/u8:1+events_unbound23:05:533
982152995042,6cyclictest963902-21kworker/u8:0+events_unbound19:18:542
982153994942,5cyclictest1077414-21kworker/u8:0+events_unbound23:48:043
982152994943,4cyclictest1058492-21kworker/u8:3+events_unbound23:00:232
982152994943,4cyclictest1035937-21kworker/u8:2+events_unbound22:10:202
982152994943,4cyclictest1033984-21kworker/u8:0+events_unbound21:40:522
982152994943,4cyclictest1033984-21kworker/u8:0+events_unbound21:40:522
982152994942,5cyclictest1091059-21kworker/u8:0+events_unbound00:24:532
982151994943,4cyclictest992815-21kworker/u8:3+events_unbound19:55:341
982151994943,4cyclictest1060222-21kworker/u8:2+events_unbound23:01:521
982153994836,5cyclictest987705-21kworker/u8:2+events_unbound19:25:183
982152994841,5cyclictest1089247-21kworker/u8:2+events_unbound00:18:222
982152994841,5cyclictest1089247-21kworker/u8:2+events_unbound00:18:222
982152994840,6cyclictest1035937-21kworker/u8:2+events_unbound21:57:532
982152994840,6cyclictest1035937-21kworker/u8:2+events_unbound21:57:522
982152994840,6cyclictest1013605-21kworker/u8:1+events_unbound21:30:522
982151994842,4cyclictest1035937-21kworker/u8:2+events_unbound22:12:111
982151994841,5cyclictest1091059-21kworker/u8:0+events_unbound00:30:211
982151994841,5cyclictest1027331-21kworker/u8:3+events_unbound21:20:261
982153994741,4cyclictest1075675-21kworker/u8:1+events_unbound00:28:523
982153994739,6cyclictest987705-21kworker/u8:2+events_unbound19:45:243
982152994741,4cyclictest1020455-21kworker/u8:3+events_unbound21:04:522
982152994741,4cyclictest1001637-21kworker/u8:0+events_unbound20:25:532
982152994735,6cyclictest1075675-21kworker/u8:1+events_unbound00:10:212
982151994741,4cyclictest1058492-21kworker/u8:3+events_unbound23:15:531
982151994741,4cyclictest1035937-21kworker/u8:2+events_unbound22:05:211
982151994741,4cyclictest1030868-21kworker/u8:3+events_unbound21:37:041
982151994740,5cyclictest1035937-21kworker/u8:2+events_unbound22:35:211
982151994740,5cyclictest1001637-21kworker/u8:0+events_unbound20:16:521
982151994737,4cyclictest1066998-21kworker/u8:1+events_unbound23:32:271
982150994719,11cyclictest1035130-21runrttasks21:40:210
982150994719,11cyclictest1035130-21runrttasks21:40:210
982153994640,4cyclictest1075675-21kworker/u8:1+events_unbound00:18:203
982153994640,4cyclictest1075675-21kworker/u8:1+events_unbound00:18:203
982153994639,5cyclictest987705-21kworker/u8:2+events_unbound19:53:523
982153994639,5cyclictest1006859-21kworker/u8:2+events_unbound20:31:523
982152994640,4cyclictest996790-21kworker/u8:1+events_unbound19:55:362
982152994640,4cyclictest1066998-21kworker/u8:1+events_unbound23:30:232
982152994640,4cyclictest1049892-21kworker/u8:3+events_unbound22:23:542
982152994639,5cyclictest1013605-21kworker/u8:1+events_unbound21:09:522
982151994636,4cyclictest1082504-21kworker/u8:2+events_unbound00:08:181
982151994636,4cyclictest1082504-21kworker/u8:2+events_unbound00:08:181
982151994631,5cyclictest1089247-21kworker/u8:2+events_unbound00:18:531
982151994631,5cyclictest1089247-21kworker/u8:2+events_unbound00:18:521
982153994539,4cyclictest996790-21kworker/u8:1+events_unbound20:26:533
982153994539,4cyclictest1091059-21kworker/u8:0+events_unbound00:31:513
982153994539,4cyclictest1075675-21kworker/u8:1+events_unbound23:40:183
982153994539,4cyclictest1075675-21kworker/u8:1+events_unbound23:40:183
982152994538,5cyclictest1013605-21kworker/u8:1+events_unbound21:35:192
982151994537,6cyclictest1075675-21kworker/u8:1+events_unbound23:53:131
982152994438,4cyclictest1033984-21kworker/u8:0+events_unbound21:45:272
982152994436,4cyclictest1035937-21kworker/u8:2+events_unbound22:37:142
982152994436,4cyclictest0-21swapper/223:45:012
982152994436,4cyclictest0-21swapper/223:45:012
982152994433,5cyclictest1033984-21kworker/u8:0+events_unbound21:50:222
982150994437,4cyclictest1082539-21munin-run00:00:000
982153994325,6cyclictest963902-21kworker/u8:0+events_unbound19:17:093
982152994337,4cyclictest1015495-21kworker/u8:2+events_unbound21:10:512
982152994337,4cyclictest1010287-21kworker/u8:3+events_unbound20:50:212
982152994333,6cyclictest0-21swapper/200:00:012
982151994335,4cyclictest998639-21latency_hist19:55:021
982150994336,4cyclictest1013832-21cron20:39:590
982153994236,4cyclictest1075675-21kworker/u8:1+events_unbound00:06:533
982153994236,4cyclictest1075675-21kworker/u8:1+events_unbound00:06:533
982153994235,5cyclictest1049892-21kworker/u8:3+events_unbound22:25:523
982153994234,6cyclictest996790-21kworker/u8:1+events_unbound20:10:523
982153994234,6cyclictest1015495-21kworker/u8:2+events_unbound20:55:243
982152994227,9cyclictest1066998-21kworker/u8:1+events_unbound23:21:192
982152994226,7cyclictest1033984-21kworker/u8:0+events_unbound22:01:582
982152994226,7cyclictest1033984-21kworker/u8:0+events_unbound22:01:582
982151994236,4cyclictest1075675-21kworker/u8:1+events_unbound00:28:461
982151994236,4cyclictest1013605-21kworker/u8:1+events_unbound20:41:561
982150994216,11cyclictest991395-21latency_hist19:35:020
982153994135,4cyclictest1075675-21kworker/u8:1+events_unbound00:38:523
982153994135,4cyclictest1053309-21kworker/u8:0+events_unbound23:00:023
982153994135,4cyclictest1015495-21kworker/u8:2+events_unbound20:45:193
982153994132,6cyclictest1061626-21unixbench_singl22:55:253
982152994134,5cyclictest1001637-21kworker/u8:0+events_unbound20:43:532
982152994132,7cyclictest1003400-21kworker/u8:2+events_unbound20:09:182
982152994115,13cyclictest0-21swapper/219:45:502
982150994133,5cyclictest0-21swapper/021:20:010
982153994032,6cyclictest1043059-21kworker/u8:3+events_unbound22:07:113
982153994023,5cyclictest1060222-21kworker/u8:2+events_unbound23:16:103
982152994034,4cyclictest1058492-21kworker/u8:3+events_unbound23:11:532
982151994032,6cyclictest1073901-21kworker/u8:3+events_unbound00:02:521
982151994030,5cyclictest0-21swapper/121:20:011
982151994030,4cyclictest1048151-21kworker/u8:1+events_unbound22:25:271
982150994030,5cyclictest1067168-21sh23:15:010
982153993933,4cyclictest1070214-21kworker/u8:0+events_unbound23:22:183
982153993933,4cyclictest1030868-21kworker/u8:3+events_unbound21:35:223
982153993926,5cyclictest992815-21kworker/u8:3+events_unbound19:40:223
982153993922,6cyclictest1035937-21kworker/u8:2+events_unbound22:30:593
982153993922,10cyclictest1020455-21kworker/u8:3+events_unbound21:01:163
982153993915,12cyclictest131rcu_preempt00:10:153
982152993931,6cyclictest996790-21kworker/u8:1+events_unbound20:10:482
982151993924,6cyclictest1001637-21kworker/u8:0+events_unbound20:22:131
982150993932,4cyclictest1010435-21cut20:30:010
982150993931,4cyclictest0-21swapper/022:20:000
982150993930,6cyclictest121ktimers/023:00:110
982153993832,4cyclictest1073901-21kworker/u8:3+events_unbound23:54:533
982153993832,4cyclictest1030868-21kworker/u8:3+events_unbound21:46:523
982153993823,4cyclictest963902-21kworker/u8:0+events_unbound19:14:143
982153993821,9cyclictest131rcu_preempt20:04:273
982153993816,12cyclictest131rcu_preempt23:10:193
982152993832,4cyclictest1049892-21kworker/u8:3+events_unbound22:40:072
982152993831,5cyclictest1077414-21kworker/u8:0+events_unbound00:05:282
982152993831,5cyclictest1077414-21kworker/u8:0+events_unbound00:05:282
982152993827,7cyclictest0-21swapper/219:55:022
982151993832,4cyclictest983685-21kworker/u8:1+events_unbound19:21:411
982151993831,5cyclictest1053309-21kworker/u8:0+events_unbound22:59:521
982151993820,10cyclictest1091059-21kworker/u8:0+events_unbound00:24:361
98215099388,16cyclictest1076372-21cat23:40:170
98215099388,16cyclictest1076372-21cat23:40:160
982153993731,4cyclictest1003400-21kworker/u8:2+events_unbound20:08:193
982153993725,5cyclictest1066998-21kworker/u8:1+events_unbound23:30:183
982153993719,5cyclictest131rcu_preempt20:45:013
982153993717,5cyclictest131rcu_preempt21:05:253
982153993711,5cyclictest0-21swapper/321:40:113
982153993711,5cyclictest0-21swapper/321:40:113
982152993731,4cyclictest1058492-21kworker/u8:3+events_unbound23:18:162
982152993731,4cyclictest1053309-21kworker/u8:0+events_unbound22:59:182
982152993730,5cyclictest1010287-21kworker/u8:3+events_unbound20:32:522
982151993731,4cyclictest1073901-21kworker/u8:3+events_unbound23:41:091
982151993731,4cyclictest1073901-21kworker/u8:3+events_unbound23:41:091
982151993731,4cyclictest1058492-21kworker/u8:3+events_unbound22:48:521
982151993730,5cyclictest1001637-21kworker/u8:0+events_unbound20:36:541
982151993727,6cyclictest1081273-21fschecks_time23:55:131
982151993724,6cyclictest1013605-21kworker/u8:1+events_unbound21:00:381
982151993718,6cyclictest131rcu_preempt19:10:131
982150993730,4cyclictest1075285-21unixbench_singl23:35:270
982150993712,5cyclictest2-21kthreadd22:00:000
982150993712,5cyclictest2-21kthreadd22:00:000
982153993629,5cyclictest1056768-21kworker/u8:1+events_unbound22:50:513
982153993629,5cyclictest1044941-21kworker/u8:0+events_unbound22:12:523
982153993628,6cyclictest1023761-21kworker/u8:0+events_unbound21:16:083
982153993625,6cyclictest0-21swapper/323:25:273
982153993620,5cyclictest131rcu_preempt22:05:013
982153993620,5cyclictest131rcu_preempt22:05:003
982153993617,7cyclictest131rcu_preempt20:15:103
982152993630,4cyclictest1006859-21kworker/u8:2+events_unbound20:36:202
982152993618,5cyclictest131rcu_preempt19:20:162
982151993630,4cyclictest963902-21kworker/u8:0+events_unbound19:28:531
982151993630,4cyclictest963902-21kworker/u8:0+events_unbound19:16:391
982151993630,4cyclictest1010287-21kworker/u8:3+events_unbound20:50:521
982151993628,5cyclictest1036024-21cron21:45:001
982151993628,5cyclictest1036024-21cron21:45:001
982151993625,6cyclictest0-21swapper/120:05:321
982151993623,7cyclictest1001637-21kworker/u8:0+events_unbound20:25:291
982151993622,6cyclictest1060222-21kworker/u8:2+events_unbound23:45:541
982151993621,6cyclictest1033984-21kworker/u8:0+events_unbound21:54:571
982150993625,8cyclictest121ktimers/019:45:120
982153993529,4cyclictest1013605-21kworker/u8:1+events_unbound20:50:233
982153993528,5cyclictest1049892-21kworker/u8:3+events_unbound22:42:533
982153993525,6cyclictest0-21swapper/300:05:013
982153993523,6cyclictest963902-21kworker/u8:0+events_unbound19:30:173
982153993523,4cyclictest131rcu_preempt23:35:213
982153993517,11cyclictest131rcu_preempt21:30:243
982152993529,4cyclictest1091059-21kworker/u8:0+events_unbound00:38:502
982152993527,6cyclictest1015495-21kworker/u8:2+events_unbound20:56:192
982151993529,4cyclictest1044941-21kworker/u8:0+events_unbound22:19:121
982150993525,7cyclictest1086552-21tune2fs00:10:140
982150993524,6cyclictest0-21swapper/020:30:260
982150993513,5cyclictest0-21swapper/023:45:150
982153993428,4cyclictest1029088-21kworker/u8:0+events_unbound21:28:123
982153993425,6cyclictest143-21jbd2/mmcblk1p2-822:15:223
98215299348,10cyclictest131rcu_preempt23:45:232
982151993430,2cyclictest1060222-21kworker/u8:2+events_unbound23:39:171
982151993428,4cyclictest1049892-21kworker/u8:3+events_unbound22:32:141
982151993423,8cyclictest1043276-21auditctl22:05:011
982151993423,8cyclictest1043276-21auditctl22:05:011
982151993418,6cyclictest131rcu_preempt21:05:131
98215099347,7cyclictest151rcuc/023:20:000
98215099346,7cyclictest11-21ksoftirqd/019:20:220
982150993425,5cyclictest0-21swapper/023:35:010
982150993425,4cyclictest0-21swapper/019:55:380
982150993423,7cyclictest0-21swapper/023:05:240
982153993323,5cyclictest1056768-21kworker/u8:1+events_unbound22:46:483
982153993318,5cyclictest131rcu_preempt20:40:013
982153993315,5cyclictest131rcu_preempt00:20:233
982152993327,4cyclictest963902-21kworker/u8:0+events_unbound19:38:202
982152993327,3cyclictest1080830-21kthreadd23:54:592
982152993323,7cyclictest1070971-21fschecks_count23:25:152
982151993327,4cyclictest1065171-21kworker/u8:0+events_unbound23:12:221
982151993326,5cyclictest987705-21kworker/u8:2+events_unbound19:44:551
982151993324,7cyclictest996790-21kworker/u8:1+events_unbound20:00:511
982151993322,6cyclictest0-21swapper/122:40:271
98215099338,7cyclictest11-21ksoftirqd/019:55:010
98215099337,10cyclictest1045438-21cut22:10:160
98215099336,13cyclictest11-21ksoftirqd/021:24:030
98215099334,7cyclictest11-21ksoftirqd/021:10:140
982150993324,5cyclictest0-21swapper/023:20:240
982150993321,6cyclictest0-21swapper/022:20:240
982150993320,8cyclictest0-21swapper/000:29:590
982152993224,5cyclictest0-21swapper/223:40:002
982152993213,3cyclictest131rcu_preempt20:22:032
982151993226,4cyclictest1070214-21kworker/u8:0+events_unbound23:23:551
982151993225,5cyclictest1013605-21kworker/u8:1+events_unbound20:49:421
982151993223,5cyclictest1087497-21kworker/u8:3+events_unbound00:13:451
982151993219,5cyclictest963902-21kworker/u8:0+events_unbound19:35:131
98215099329,6cyclictest0-21swapper/000:35:150
98215099328,7cyclictest11-21ksoftirqd/022:10:000
98215099327,6cyclictest11-21ksoftirqd/020:50:280
98215099325,13cyclictest11-21ksoftirqd/021:00:140
98215099323,10cyclictest1091296-21sh00:25:000
982150993224,4cyclictest1058647-21munin-plugin-st22:50:000
982150993223,6cyclictest1031491-21kernelversion21:30:170
98215099322,15cyclictest11-21ksoftirqd/019:30:010
982152993125,4cyclictest1089247-21kworker/u8:2+events_unbound00:27:182
982152993119,9cyclictest311ktimers/219:30:002
982152993116,9cyclictest992815-21kworker/u8:3+events_unbound20:04:422
982152993115,5cyclictest131rcu_preempt21:20:212
982151993124,5cyclictest1033984-21kworker/u8:0+events_unbound21:45:151
982151993121,6cyclictest0-21swapper/100:35:281
98215099317,7cyclictest11-21ksoftirqd/021:05:250
98215099316,7cyclictest0-21swapper/021:50:220
98215099316,6cyclictest1006431-21sed20:15:260
98215099315,6cyclictest0-21swapper/022:40:130
982151993024,4cyclictest963902-21kworker/u8:0+events_unbound19:31:351
982151993022,4cyclictest0-21swapper/121:55:281
982151993022,4cyclictest0-21swapper/121:55:281
98215099308,7cyclictest0-21swapper/020:10:160
98215099307,6cyclictest11-21ksoftirqd/022:30:170
98215099307,5cyclictest11-21ksoftirqd/022:40:010
98215099307,3cyclictest151rcuc/019:40:300
98215099304,8cyclictest11-21ksoftirqd/022:55:250
98215099304,6cyclictest11-21ksoftirqd/000:05:200
98215099304,6cyclictest11-21ksoftirqd/000:05:190
98215099303,5cyclictest11-21ksoftirqd/021:35:250
98215099301,6cyclictest11-21ksoftirqd/022:50:150
98215399297,4cyclictest0-21swapper/319:25:003
982151992923,4cyclictest1065171-21kworker/u8:0+events_unbound23:09:551
98215099298,7cyclictest0-21swapper/020:00:160
98215099294,8cyclictest11-21ksoftirqd/000:30:170
98215099294,6cyclictest11-21ksoftirqd/023:50:230
98215099294,6cyclictest11-21ksoftirqd/021:00:010
982150992921,5cyclictest0-21swapper/020:40:160
982151992818,6cyclictest0-21swapper/119:45:271
98215099288,7cyclictest0-21swapper/021:45:040
98215099287,5cyclictest11-21ksoftirqd/020:45:280
98215099286,5cyclictest11-21ksoftirqd/022:00:180
98215099286,5cyclictest11-21ksoftirqd/022:00:170
98215099285,7cyclictest11-21ksoftirqd/000:15:150
98215099285,7cyclictest11-21ksoftirqd/000:15:150
98215099285,4cyclictest151rcuc/023:25:260
98215099283,5cyclictest11-21ksoftirqd/020:05:300
982150992821,5cyclictest121ktimers/020:20:100
98215099281,11cyclictest13950irq/36-mmc119:15:010
98215099274,6cyclictest0-21swapper/019:35:220
982151992620,4cyclictest1015495-21kworker/u8:2+events_unbound21:31:451
98215099264,6cyclictest11-21ksoftirqd/022:25:230
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional