You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-10 - 18:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Thu Sep 10, 2026 12:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
305125321300,3sleep30-21swapper/310:25:213
305125321300,3sleep30-21swapper/310:25:203
300305221170,2sleep30-21swapper/308:10:153
298058228040,12sleep00-21swapper/007:08:170
297994827646,22sleep20-21swapper/207:05:222
139099760,65rtkit-daemon0-21swapper/107:09:421
298054927041,23sleep30-21swapper/307:07:523
30186002500,2sleep10-21swapper/108:55:111
30527332480,4sleep00-21swapper/010:30:190
29885402480,2sleep33056-21PK-Backend07:30:013
30734272460,2sleep03056-21PK-Backend11:30:180
30220722440,4sleep33056-21PK-Backend09:05:133
30729592420,3sleep30-21swapper/311:30:003
30950022410,2sleep00-21swapper/012:30:130
139099340,4rtkit-daemon1788643-21eadedCompositor10:54:320
139099330,5rtkit-daemon945-21thermald07:25:030
139099320,2rtkit-daemon0-21swapper/011:16:210
139099320,2rtkit-daemon0-21swapper/008:43:180
139099310,2rtkit-daemon0-21swapper/009:21:110
139099300,2rtkit-daemon0-21swapper/009:44:190
298085899282,12cyclictest3069330-21basename11:20:001
298085899252,4cyclictest3040437-21processes09:55:211
298085899242,8cyclictest3084579-21python312:00:211
298085899242,6cyclictest3055666-21cstates10:40:111
298085899241,9cyclictest3090908-21dump-pmu-power12:19:591
2980858992414,7cyclictest436-20systemd-journal11:10:011
139099240,3rtkit-daemon1389-21rtkit-daemon10:37:561
139099240,3rtkit-daemon1389-21rtkit-daemon07:30:560
298086199234,17cyclictest2988935-21tr07:30:122
298085899236,6cyclictest26-21ksoftirqd/110:10:111
298085899232,8cyclictest3014327-21taskset08:42:271
298085899231,9cyclictest30513942sleep110:25:591
298085899231,9cyclictest30513942sleep110:25:591
298085899231,8cyclictest3080842-21python311:50:201
2980858992315,7cyclictest3034577-21iwlist09:40:151
2980856992321,1cyclictest0-21swapper/011:04:030
2980856992312,9cyclictest3032165-21unin-run09:35:000
2980856992312,9cyclictest3032165-21unin-run09:34:590
139099230,3rtkit-daemon1389-21rtkit-daemon08:54:531
298086699224,15cyclictest3077350-21processes11:40:193
2980866992213,7cyclictest2361-21gdbus11:57:033
298086699220,20cyclictest3056-21PK-Backend08:30:183
2980861992220,1cyclictest0-21swapper/212:16:472
2980861992220,1cyclictest0-21swapper/211:56:462
2980861992220,1cyclictest0-21swapper/209:50:532
2980861992214,6cyclictest3067564-21cron11:15:012
298085899222,19cyclictest0-21swapper/107:40:361
2980858992220,1cyclictest0-21swapper/111:14:091
2980858992220,1cyclictest0-21swapper/111:00:241
2980858992220,1cyclictest0-21swapper/108:21:121
2980858992219,2cyclictest0-21swapper/110:17:251
298085899221,8cyclictest3059783-21python310:50:211
298085899221,8cyclictest2995081-21users07:45:231
2980858992215,4cyclictest2984756-21latency_hist07:20:011
2980858992213,7cyclictest3074780-21apt11:35:111
2980858992213,7cyclictest3072776-21cron11:30:001
2980858992213,6cyclictest3087571-21cut12:10:021
298085899220,21cyclictest0-21swapper/109:12:151
2980856992220,1cyclictest0-21swapper/012:17:440
2980856992220,1cyclictest0-21swapper/011:41:140
2980856992220,1cyclictest0-21swapper/008:05:030
139099220,3rtkit-daemon1389-21rtkit-daemon10:00:391
139099220,3rtkit-daemon1389-21rtkit-daemon08:02:501
30737942210,5chrt0-21swapper/111:30:231
2980866992118,2cyclictest3056-21PK-Backend09:52:523
2980866992118,2cyclictest0-21swapper/311:50:133
2980866992113,6cyclictest3076278-21systemd11:40:013
298086699210,20cyclictest3056-21PK-Backend08:55:133
298086699210,20cyclictest3056-21PK-Backend08:00:033
298086699210,1cyclictest3056-21PK-Backend09:38:183
298086699210,19cyclictest3056-21PK-Backend12:27:103
298086699210,19cyclictest3056-21PK-Backend12:24:133
298086699210,19cyclictest3056-21PK-Backend10:58:073
298086699210,19cyclictest3056-21PK-Backend08:06:123
2980861992119,1cyclictest0-21swapper/212:02:072
2980861992119,1cyclictest0-21swapper/211:52:132
2980861992119,1cyclictest0-21swapper/211:39:352
2980861992119,1cyclictest0-21swapper/210:13:582
2980861992119,1cyclictest0-21swapper/209:21:042
2980861992119,1cyclictest0-21swapper/209:18:152
2980861992119,1cyclictest0-21swapper/208:55:302
2980861992119,1cyclictest0-21swapper/208:32:392
2980861992119,1cyclictest0-21swapper/208:15:352
2980861992119,1cyclictest0-21swapper/208:11:092
2980861992119,1cyclictest0-21swapper/208:07:442
2980861992119,1cyclictest0-21swapper/208:01:222
2980861992119,1cyclictest0-21swapper/207:46:492
2980861992119,1cyclictest0-21swapper/207:18:372
2980861992117,3cyclictest0-21swapper/211:27:122
2980861992113,6cyclictest3057819-21cat10:45:172
2980861992113,6cyclictest3056314-21sensors_temp10:40:192
298086199210,20cyclictest3056-21PK-Backend12:07:262
298086199210,20cyclictest0-21swapper/210:57:042
298086199210,20cyclictest0-21swapper/209:57:222
298086199210,20cyclictest0-21swapper/209:41:332
298086199210,20cyclictest0-21swapper/208:44:212
298085899215,6cyclictest26-21ksoftirqd/110:55:011
298085899215,4cyclictest3069580-21apt11:20:111
298085899214,5cyclictest3026707-21taskset09:17:161
2980858992119,1cyclictest3056-21PK-Backend11:56:001
2980858992119,1cyclictest3056-21PK-Backend11:41:391
2980858992119,1cyclictest0-21swapper/109:34:191
2980858992119,1cyclictest0-21swapper/109:34:191
2980858992119,1cyclictest0-21swapper/109:28:511
2980858992119,1cyclictest0-21swapper/108:48:021
2980858992119,1cyclictest0-21swapper/108:18:211
2980858992119,1cyclictest0-21swapper/108:14:431
2980858992119,1cyclictest0-21swapper/108:07:531
2980858992119,1cyclictest0-21swapper/107:22:171
2980858992119,1cyclictest0-21swapper/107:11:091
298085899210,20cyclictest3056-21PK-Backend12:29:121
298085899210,20cyclictest0-21swapper/109:46:151
298085899210,20cyclictest0-21swapper/108:32:331
298085899210,20cyclictest0-21swapper/108:29:161
2980856992119,1cyclictest3056-21PK-Backend10:26:310
2980856992119,1cyclictest3056-21PK-Backend10:26:310
2980856992119,1cyclictest0-21swapper/011:45:470
2980856992119,1cyclictest0-21swapper/011:10:110
2980856992113,6cyclictest2982286-21systemd-udevd07:12:120
298085699210,4cyclictest13-21ksoftirqd/009:10:000
298085699210,20cyclictest3056-21PK-Backend11:50:190
298085699210,20cyclictest3056-21PK-Backend07:45:090
298085699210,20cyclictest0-21swapper/011:28:230
298085699210,20cyclictest0-21swapper/010:06:570
298085699210,20cyclictest0-21swapper/009:53:050
298085699210,20cyclictest0-21swapper/009:25:340
139099210,3rtkit-daemon1389-21rtkit-daemon11:55:200
2980866992018,1cyclictest3056-21PK-Backend09:58:193
2980866992018,1cyclictest0-21swapper/307:34:353
2980866992017,2cyclictest3056-21PK-Backend12:13:323
2980866992013,5cyclictest3079287-21cat11:45:213
298086699200,1cyclictest3056-21PK-Backend11:01:193
298086699200,19cyclictest3056-21PK-Backend10:36:183
298086699200,19cyclictest3056-21PK-Backend09:43:463
298086699200,19cyclictest3056-21PK-Backend09:15:413
298086699200,19cyclictest3056-21PK-Backend07:59:163
298086699200,19cyclictest3056-21PK-Backend07:41:523
298086699200,19cyclictest3056-21PK-Backend07:24:483
298086699200,19cyclictest0-21swapper/310:16:313
298086699200,19cyclictest0-21swapper/307:49:153
2980861992018,1cyclictest0-21swapper/212:39:512
2980861992018,1cyclictest0-21swapper/211:46:252
2980861992018,1cyclictest0-21swapper/210:28:312
2980861992018,1cyclictest0-21swapper/210:28:312
2980861992018,1cyclictest0-21swapper/209:31:262
2980861992018,1cyclictest0-21swapper/209:31:262
2980861992018,1cyclictest0-21swapper/209:01:182
2980861992018,1cyclictest0-21swapper/207:57:372
2980861992018,1cyclictest0-21swapper/207:40:132
2980861992013,5cyclictest3048588-21cat10:20:112
298086199200,1cyclictest0-21swapper/210:30:202
298086199200,19cyclictest0-21swapper/212:34:452
298086199200,19cyclictest0-21swapper/212:26:062
298086199200,19cyclictest0-21swapper/211:06:022
298086199200,19cyclictest0-21swapper/209:49:512
298086199200,19cyclictest0-21swapper/208:45:082
298085899208,3cyclictest26-21ksoftirqd/107:52:551
2980858992018,1cyclictest0-21swapper/107:57:121
2980858992017,2cyclictest251rcuc/110:21:421
298085899200,19cyclictest3056-21PK-Backend10:47:041
298085899200,19cyclictest0-21swapper/112:11:491
298085899200,19cyclictest0-21swapper/110:06:301
298085899200,19cyclictest0-21swapper/109:51:431
298085899200,19cyclictest0-21swapper/109:01:001
2980856992017,2cyclictest0-21swapper/011:37:290
2980856992014,4cyclictest13-21ksoftirqd/007:20:160
298085699200,1cyclictest0-21swapper/007:17:380
298085699200,19cyclictest0-21swapper/012:22:510
298085699200,19cyclictest0-21swapper/009:58:190
298085699200,19cyclictest0-21swapper/008:49:380
298085699200,19cyclictest0-21swapper/008:03:280
2980866991917,1cyclictest3056-21PK-Backend12:18:533
2980866991917,1cyclictest3056-21PK-Backend08:22:413
2980866991917,1cyclictest0-21swapper/312:36:373
2980866991917,1cyclictest0-21swapper/307:50:033
2980866991916,2cyclictest3056-21PK-Backend07:18:133
2980866991911,6cyclictest883-21dbus-daemon12:05:013
298086699190,1cyclictest3056-21PK-Backend10:53:423
298086699190,1cyclictest3056-21PK-Backend10:31:523
298086699190,1cyclictest3056-21PK-Backend09:02:363
298086699190,1cyclictest3056-21PK-Backend08:52:023
298086699190,1cyclictest3056-21PK-Backend08:26:333
298086699190,1cyclictest3056-21PK-Backend08:19:513
298086699190,1cyclictest3056-21PK-Backend07:13:473
298086699190,18cyclictest3056-21PK-Backend09:13:513
298086699190,18cyclictest3056-21PK-Backend08:46:413
298086699190,18cyclictest0-21swapper/312:31:303
2980861991917,1cyclictest3056-21PK-Backend11:34:342
2980861991917,1cyclictest0-21swapper/210:00:122
2980861991917,1cyclictest0-21swapper/208:20:152
2980861991917,1cyclictest0-21swapper/207:51:082
2980861991914,4cyclictest978-21snmpd07:12:182
298086199190,1cyclictest3056-21PK-Backend09:25:452
298086199190,1cyclictest0-21swapper/212:14:232
298086199190,1cyclictest0-21swapper/211:44:362
298086199190,1cyclictest0-21swapper/210:35:472
298086199190,1cyclictest0-21swapper/209:35:052
298086199190,1cyclictest0-21swapper/209:07:202
298086199190,1cyclictest0-21swapper/207:26:552
298086199190,1cyclictest0-21swapper/207:22:492
2980858991917,1cyclictest3056-21PK-Backend12:35:411
2980858991917,1cyclictest3056-21PK-Backend07:35:491
2980858991917,1cyclictest0-21swapper/110:33:331
2980858991917,1cyclictest0-21swapper/109:35:201
2980858991917,1cyclictest0-21swapper/108:38:011
2980858991917,1cyclictest0-21swapper/107:25:491
2980858991916,2cyclictest251rcuc/111:46:281
298085899190,1cyclictest0-21swapper/112:23:181
298085899190,1cyclictest0-21swapper/109:07:491
298085899190,18cyclictest3056-21PK-Backend12:31:221
298085699197,5cyclictest13-21ksoftirqd/010:55:010
298085699195,12cyclictest3026927-21cron09:20:010
2980856991917,1cyclictest0-21swapper/011:22:270
2980856991917,1cyclictest0-21swapper/011:08:350
2980856991917,1cyclictest0-21swapper/010:20:570
2980856991917,1cyclictest0-21swapper/008:26:530
2980856991916,2cyclictest0-21swapper/009:00:190
2980856991914,3cyclictest3089165-21idleruntime-cro12:15:000
2980856991914,3cyclictest2156-21gnome-shell12:35:090
2980856991914,3cyclictest1095-21runrttasks10:00:180
298085699190,1cyclictest0-21swapper/010:38:070
298085699190,1cyclictest0-21swapper/009:47:030
298085699190,1cyclictest0-21swapper/009:39:130
298085699190,18cyclictest0-21swapper/008:57:560
139099190,15rtkit-daemon2980848-21cyclictest08:10:040
29927502180,3chrt0-21swapper/007:40:170
2980866991816,1cyclictest3056-21PK-Backend12:06:023
2980866991815,2cyclictest3056-21PK-Backend09:49:133
2980866991812,5cyclictest42-21ksoftirqd/311:30:173
298086699180,1cyclictest3056-21PK-Backend08:38:163
298086699180,1cyclictest0-21swapper/310:07:243
2980861991816,1cyclictest0-21swapper/210:16:482
2980861991816,1cyclictest0-21swapper/210:08:302
2980861991816,1cyclictest0-21swapper/208:39:282
2980861991816,1cyclictest0-21swapper/207:37:092
2980861991814,3cyclictest978-21snmpd11:02:252
2980861991811,6cyclictest3009357-21awk08:30:002
298085899181,6cyclictest26-21ksoftirqd/109:20:171
2980856991816,1cyclictest0-21swapper/012:05:340
2980856991816,1cyclictest0-21swapper/008:24:030
2980856991816,1cyclictest0-21swapper/008:16:120
2980856991816,1cyclictest0-21swapper/007:53:200
2980856991813,4cyclictest13-21ksoftirqd/010:50:010
2980856991813,4cyclictest13-21ksoftirqd/008:35:000
2980856991813,3cyclictest13-21ksoftirqd/010:15:010
2980856991811,6cyclictest2998008-21sed07:55:160
2980856991811,5cyclictest3085214-21gpgv12:05:010
2980856991811,5cyclictest3023628-21grep09:10:150
298085699180,5cyclictest3018004-21dump-pmu-power08:55:000
298085699180,5cyclictest0-21swapper/008:35:170
298085699180,17cyclictest0-21swapper/007:37:180
298086699179,6cyclictest3055559-21cat10:40:113
298086699171,8cyclictest141rcu_preempt09:35:003
298086699171,8cyclictest141rcu_preempt09:35:003
2980866991715,1cyclictest3056-21PK-Backend10:01:103
2980866991715,1cyclictest3056-21PK-Backend09:21:083
2980866991714,2cyclictest3056-21PK-Backend09:29:263
2980866991712,3cyclictest3045268-21irqstats10:10:153
2980866991711,4cyclictest3068617-21pluginstate11:15:203
298086699171,14cyclictest3058052-21python310:45:203
298086699170,15cyclictest3071242-21wc11:25:003
298086699170,15cyclictest3048891-21df_inode10:20:123
298086699170,15cyclictest2990850-21df_inode07:35:123
2980861991711,5cyclictest3060548-21sed10:55:012
298085699175,4cyclictest13-21ksoftirqd/010:17:490
2980856991715,1cyclictest0-21swapper/010:44:430
2980866991610,4cyclictest30145232sleep308:45:013
298085899162,9cyclictest2988753-21apt07:30:101
298085699168,6cyclictest3093139-21ls12:25:130
298086699157,6cyclictest3065842-21cron11:10:013
298086699150,2cyclictest3056-21PK-Backend11:12:313
2980861991514,1cyclictest0-21swapper/209:12:472
2980861991510,4cyclictest3071079-21wc11:25:002
298086199149,4cyclictest978-21snmpd08:51:182
298086199142,10cyclictest3092624-21cron12:25:002
298086199128,3cyclictest0-21swapper/211:16:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional