PGI User Forum
 SearchSearch   MemberlistMemberlist     RegisterRegister   ProfileProfile    Log inLog in 

CUDA-x86.

launch timed out and was terminated....
Goto page 1, 2  Next
 
Post new topic   Reply to topic    PGI User Forum Forum Index -> Accelerator Programming
View previous topic :: View next topic  
Author Message
alfvenwave



Joined: 08 Apr 2010
Posts: 79

PostPosted: Fri Oct 15, 2010 7:20 am    Post subject: launch timed out and was terminated.... Reply with quote

Can anyone explain what might be causing this? It doesn't seem to be compiler or hardware dependent.


0: copyout Memcpy (host=0x7f840030, dev=0x8198000, size=16384) FAILED: 6(the launch timed out and was terminated)


Rob.
Back to top
View user's profile
mkcolg



Joined: 30 Jun 2004
Posts: 6134
Location: The Portland Group Inc.

PostPosted: Fri Oct 15, 2010 2:21 pm    Post subject: Reply with quote

Hi Rob,

Do you have your monitor attached to your GPU? X windows will kill any long running job (~5-15 seconds) if your GPU is attached to a monitor.

- Mat
Back to top
View user's profile
alfvenwave



Joined: 08 Apr 2010
Posts: 79

PostPosted: Sat Oct 16, 2010 1:56 am    Post subject: Reply with quote

Hi Mat,

The job runs for about 2 hours before failing. We do have a diagnostic monitor available in the rack, but I think it's disconnected. I will check on Monday, but I don't think it's this. I did wonder whether it's because one of my GPUs is sitting idle for too long waiting for the other cards to finish.

I'll do further tests and let you know what I find.

Rob.
Back to top
View user's profile
alfvenwave



Joined: 08 Apr 2010
Posts: 79

PostPosted: Tue Oct 19, 2010 11:19 am    Post subject: Reply with quote

Mat, thanks for pointing us in the right direction. Although we didn't have a monitor connected, we were running X. Turning X off resulted in my code hanging rather than crashing. The cause of the hang is I believe a "killer particle" (it's a Monte Carlo code) that ends up in an infinite loop.

Thanks again,

Rob.
Back to top
View user's profile
cyFeng



Joined: 05 Mar 2010
Posts: 17

PostPosted: Thu Jun 16, 2011 6:17 am    Post subject: Reply with quote

The same message occurred in the following test case while input N=102400.
However, N=92160 or less would be fine.
My gpu device is GeForce GT 415M and PVF version 10.9.
The OS is Win7.
The execution was compiled with Compute Capacity 2.0 and CUDA toolkit 3.1.
Did I miss anything..?

Code:

Module kmod
   use cudafor
   contains
   Attributes(global) subroutine vaddkernel(A,B,C,N)
     real, device:: A(*), B(*), C(*)
     integer, value:: N
     integer:: I, j
     i = (blockidx%x-1)*512 + threadidx%x
     if ( I <= N )then
       do j=1, N
         C(i)= A(i) + B(i)
       end do
     end if
   End subroutine vaddkernel
End module kmod
!-----------------------------------------------------------------------------
program gpu_test
use dfport
use kmod
implicit none
real,allocatable:: A(:), B(:), C(:), D(:), E(:)
real,device,allocatable:: AA(:), BB(:), CC(:)
type(dim3)::dimGrid, dimBlock

integer:: N,i
real:: s1, s2

read(*,*) N
dimGrid  = dim3(N/512, 1, 1)
dimBlock = dim3(512, 1, 1)

allocate(A(N), B(N), C(N), D(N), E(N))
allocate(AA(N), BB(N), CC(N))

do i=1,N
  A(i) = real(i)
  B(i) = cos(real(i))
end do

call cpu_time(s1)
call acc_vadd( A, B, D, N)
call cpu_time(s2)
print*, "GPU, PGI Accelerator (acc) vadd: ", s2-s1

call cpu_time(s1)
AA(1:N)=A(1:N)
BB(1:N)=B(1:N)
call vaddkernel <<<dimGrid,dimBlock>>> ( AA, BB, CC, N)
E(1:N)=CC(1:N)
call cpu_time(s2)
print*, "GPU, PGI CUDA Fortran vadd: ", s2-s1
deallocate(AA, BB, CC)

do i=1,N
  if( E(i)/=D(i) )then
    print*, "different", i, E(i)-D(i)
    exit
  end if
end do
end program gpu_test
Back to top
View user's profile
Display posts from previous:   
Post new topic   Reply to topic    PGI User Forum Forum Index -> Accelerator Programming All times are GMT - 7 Hours
Goto page 1, 2  Next
Page 1 of 2

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum


Powered by phpBB © phpBB Group